Data Engineer

Orion Innovation is a premier, award-winning, global business and technology services firm.  Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity.  We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

ROLE SUMMARY

The Company’s Commercialization Business Insights & Technology (CBI&T) Dat and AI (D&A) New Build team is responsible for executing on prioritized work leveraging Databricks as its data foundation platform.

Seeking US Data Lead to manage delivery of these data assets and data products end to end. This position is the technical point of contact for this work, translating business requirements from our Commercialization AI Strategy & Analytics (CASA) business partners into designed, built, tested, and released data products on Databricks.

Work with US data team members, other commercialization BI&T stakeholders, company offshore engineers and systems integrator resources.

MUST HAVE DATABRICKS EXP, DATA MODELING EXP, AND DATA PRODUCTS EXP.

KEY RESPONSIBILITIES

Data delivery

• Lead design, build, UAT, releases

• Partner with CASA data owners, domain leads, and business SMEs to translate data product scope: critical data elements, business rules, metric definitions, grain, aggregation logic, and acceptance criteria into technical design and execution.

• Produce core design artifacts: source-to-target mappings, analytical requirement documents, Bronze, Silver Gold-layer logical data models.

Technical build and data modeling

• Hands on understanding of of Databricks tools, (PySpark, Spark SQL, Delta Lake, etc.)

• Apply platform standards for Unity Catalog cataloging, table design and clustering, performance tuning, data quality controls, and CI/CD through Git.

• Data Product data modeling

Offshore/Vendor Engagement

• Day-to-day work of an offshore engineering pod in Hyderabad, India — backlog grooming, task assignment, design review, and code review.

• Provide technical direction to systems integrator and consulting partners working on the same domains, and hold their deliverables to company standards.

• Review vendor work products against statement-of-work scope and flag gaps early.

REQUIRED QUALIFICATIONS

• 6–10+ years in data engineering

• Databricks experience