Position: Senior Data Engineer (Health Research Team)
Individuals must be legally authorized to work in the United States without the need for immigration support or sponsorship from Milliman now or in the future.
Who we are
Milliman’s Health Research Team (HRT) supports Milliman products and practices in a variety of capacities, including financial functions, client support, project management, data engineering, and data analytics services. As a shared service team, we pride ourselves on delivering high‑quality, timely support to Milliman’s clients, consultants, and leadership teams.
Job Responsibilities
- Work closely with key stakeholders to ensure data pipelines meet business objectives and data transformations meet analyst requirements.
- Write, incorporate, and maintain Databricks notebook scripts within standard processing jobs.
- Ensure the integrity of the HRT’s data pipelines, lakehouse, APIs, and products by conducting in‑depth validation reviews and applying data governance and retention policies.
- Lead comprehensive data pipeline reviews across HRT’s data assets, ensuring accuracy, completeness, consistency, and timeliness of healthcare data pipelines and downstream products.
- Design, develop, and execute systematic data validation frameworks to identify anomalies, discrepancies, and integrity issues.
- Investigate and document root causes of data pipeline failures, working with engineering and analytics teams to implement corrective actions and preventive controls.
- Establish and maintain data quality metrics, scorecards, and dashboards to monitor pipeline health and communicate findings to stakeholders.
- Deploy workflows into production environments, ensuring robust operation, monitoring performance, and promptly addressing pipeline issues to maintain reliability and stability.
- Collaborate with HRT data analytics, engineering, and project management professionals to identify, propose, and implement process enhancements.
- Assist in developing ad‑hoc data workflows that support Health Research Board (HRB) approved initiatives and Milliman practice client projects.
- Provide support to Milliman’s practices via the help desk system by answering questions about data assets and data use policies.
- Collaborate with HRT finance, operations, and project management teammates, providing technical and healthcare data expertise.
- Communicate progress, status, issues, and decisions on a regular cadence.
- Travel to Milliman’s Chicago office for three consecutive days each quarter as required.
Minimum requirements
- Bachelor’s degree in Computer / Software Engineering, Computer Science, Information Technology, Electrical Engineering, Data Science, Actuarial Science, or a similar field.
- Six or more years of relevant experience in data engineering or related roles, with advanced programming in SQL or Python.
- Strong capability to consistently produce high‑quality, accurate deliverables on schedule and effectively communicate progress and recommended next actions.
- Four or more years of experience in each of the following areas:
- Building data pipelines for enrollment, claims (medical or pharmacy), risk scores, or other common healthcare data sources.
- Data modeling and architecture within Databricks or a similar cloud‑based analytics and AI platform.
- Utilizing distributed data processing frameworks, preferably Apache Spark (PySpark/Spark SQL).
- Using Git Hub for version control, code review, and branching strategies.
- Applying best practices for data governance and retention.
- Intermediate or higher knowledge of Microsoft Office applications, including Teams, Word, PowerPoint, SharePoint, Outlook, and Adobe Acrobat.
- Travel to Milliman’s Chicago office for three consecutive days each quarter.
Competencies and Behaviors that Support Success in this Role
- Ability to use REST API to perform standard database functions.
- Experience migrating between AWS and Azure.
- Competent with coding in the SAS Windowing Environment.
- General business knowledge of at least two healthcare lines of business (e.g., individual, employer group, Medicare, Part D, Medicaid, dental).
- Exposure to CMS’ LDSSA data files.
- Proficiency in intermediate Excel skills, including complex formulas, Power Query, or VBA automation.
- Experience working…