Lead Data Engineer

Coherehealth
Hyderabad +1 more

Who this role is best for

Best suited to senior data engineers with AWS and Apache Iceberg expertise working in healthcare data platforms.

Best fit for

  • Experienced data engineers who can lead complex projects across multiple teams.
    — “Lead delivery of complex data engineering projects across multiple teams
  • Technical leaders comfortable mentoring engineers and establishing best practices.
    — “Mentor engineers and establish best practices
  • Candidates with deep expertise in AWS data services and modern data stacks.
    — “AWS S3, Glue, Athena, Lake Formation

Things to consider

  • Role involves significant responsibility for data quality and reliability frameworks.
    — “Implement data quality frameworks
  • Must be comfortable with both technical execution and architectural leadership.
    — “Drive technical execution from design through production deployment

How to stand out

  • Highlight specific examples of optimizing Apache Iceberg implementations in past roles.
    — “Lead Apache Iceberg implementation and optimization
  • Demonstrate experience with healthcare data platforms in your application.
    — “cloud-native healthcare data platform
  • Showcase leadership in modernizing legacy data workloads.
    — “Support modernization of legacy workloads
Pace · SteadyCollaboration · HighAutonomy · MediumDecision Impact · TeamLevel · Lead

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • lead data engineering initiatives
  • design and implement batch and near-real-time pipelines
  • drive observability and monitoring practices
Typical background
8–12 years of Data Engineering experiencecloud technologies

Skills & requirements

Required

AWSApache IcebergLake FormationGlue CatalogAthenadbtAirflowPythonSQLPyspark / Spark

Preferred

Delta LakeHudi

Stack & domain

Aws S3GlueAthenaLake FormationIamSecurity ControlsApache IcebergDelta LakeHudidbtAirflowStep FunctionsPythonSQLPysparkSparkData EngineeringCloud TechnologiesHealthcare

About the role

Original posting from Coherehealth via Greenhouse

Opportunity Overview:

We are seeking a Lead Data Engineer to drive the design and delivery of our cloud-native healthcare data platform. You will lead the implementation of scalable data solutions built on AWS, Apache Iceberg, Lake Formation, Glue Catalog, Athena, dbt, and modern orchestration frameworks. This role combines deep hands-on engineering with technical leadership and collaboration across platform, analytics, and business teams.

What you’ll do:

Lead Data Engineering Initiatives 

Lead delivery of complex data engineering projects across multiple teams 

Drive technical execution from design through production deployment 

Establish scalable implementation patterns Build and Optimize Data Platforms 

Design and implement batch and near-real-time pipelines 

Build reusable ingestion, transformation, validation, and publishing frameworks 

Support modernization of legacy workloads Lakehouse Engineering 

Lead Apache Iceberg implementation and optimization 

Define standards for schema evolution, partitioning, compaction, and metadata management 

Ensure efficient storage and query performance Data Quality and Reliability 

Implement data quality frameworks 

Drive observability and monitoring practices 

Improve operational excellence and reliability Technical Leadership 

Review architecture and design proposals 

Conduct code reviews and engineering reviews 

Mentor engineers and establish best practices

Required Qualifications:

8–12 years of Data Engineering experience.

Experience leading enterprise-scale data initiatives Cloud Technologies 

AWS S3, Glue, Athena, Lake Formation 

IAM and security controls Modern Data Stack 

Apache Iceberg (preferred) 

Delta Lake / Hudi • dbt • Airflow or Step FunctionsProgramming 

Python 

SQL 

PySpark / Spark

Interview Process*:

Connect with Talent Acquisition 

Meet with the Hiring Manager

Behavioral Interview(s)

Case Study

Interview with Senior Leadership

*Subject to change

About Cohere Health:

Cohere Health’s clinical intelligence platform delivers AI-powered solutions that streamline access to quality care by improving payer-provider collaboration, cost containment, and healthcare economics. Cohere Health works with over 660,000 providers and handles over 12 million prior authorization requests annually. Its responsible AI auto-approves up to 90% of requests for millions of health plan members.

With the acquisition of ZignaAI, we’ve further enhanced our platform by launching our Payment Integrity Suite, anchored by Cohere Validate™, an AI-driven clinical and coding validation solution that operates in near real-time. By unifying pre-service authorization data with post-service claims validation, we’re creating a transparent healthcare ecosystem that reduces waste, improves payer-provider collaboration and patient outcomes, and ensures providers are paid promptly and accurately.

Cohere Health’s innovations continue to receive industry wide recognition. We’ve been named to the 2025 Inc. 5000 list and in the Gartner® Hype Cycle™ for U.S. Healthcare Payers (2022-2025), and ranked as a Top 5 LinkedIn™ Startup for 2023 & 2024. Backed by leading investors such as Deerfield Management, Define Ventures, Flare Capital Partners, Longitude Capital, and Polaris Partners, Cohere Health drives more transparent, streamlined healthcare processes, helping patients receive faster, more appropriate care and higher-quality outcomes.

The Coherenauts, as we call ourselves, who succeed here are empathetic teammates who are candid, kind, caring, and embody our core values and principles. We believe that diverse, inclusive teams make the most impactful work. Cohere is deeply invested in ensuring that we have a supportive, growth-oriented environment that works for everyone.

We can’t wait to learn more about you and meet you at Cohere Health!

Equal Opportunity Statement: 

Cohere Health is an Equal Opportunity Employer. We are committed to fostering an environment of mutual respect where equal employment opportunities are available to all.  To us, it’s personal.

ISMS roles and responsibilities

Good knowledge of Information security

Oversee specific business processes within the ISMS.

Responsible to manage the ISMS documentation, conduct risk assessments, and implement risk treatment plans.

Risk Owners are responsible for identifying, assessing, and managing risks within their areas of responsibility.

They are also responsible for implementing risk treatment plans.

Conduct the BCP and other test related to information security continuity along with CISO

Responsible for monitoring and reporting on the performance of the ISMS.

Responsible for implementation of security policies and procedures and report any issues to the CISO.

Source: Coherehealth careers (Greenhouse)

Similar roles