Staff Applied AI Engineer (Observability)

We Breathe Life Into Data

At Komodo Health, our mission is to reduce the global burden of disease. And we believe that smarter use of data is essential to this mission. That’s why we built the Healthcare Map — the industry’s largest, most complete, precise view of the U.S. healthcare system — by combining de-identified, real-world patient data with innovative algorithms and decades of clinical experience. The Healthcare Map serves as our foundation for a powerful suite of software applications, helping us answer healthcare’s most complex questions for our partners. Across the healthcare ecosystem, we’re helping our clients unlock critical insights to track detailed patient behaviors and treatment patterns, identify gaps in care, address unmet patient needs, and reduce the global burden of disease.

As we pursue these goals, it remains essential to us that we stay grounded in our values: be awesome, seek growth, deliver “wow,” and enjoy the ride. At Komodo, you will be joining a team of ambitious, supportive Dragons with diverse backgrounds but a shared passion to deliver on our mission to reduce the burden of disease — and enjoy the journey along the way.

The Opportunity At Komodo Health

Healthcare in the U.S. is a mess. Komodo Health is fixing that—with data. We’ve mapped the patient journey across the country to build the most complete picture of disease burden and treatment gaps. Our customers—pharma companies, payers, and health systems—use this data to make decisions that meaningfully improve patient outcomes.

Labs@Komodo builds the AI-native platforms and systems that turn this data into action. We are the team behind Marmot, Komodo’s AI-native product—designed with AI embedded directly into both the interface and the development workflow. By combining Komodo’s unmatched healthcare data with modern LLMs, Marmot is delivering some of the most compelling real-world insights of the new AI era.

Mission Of The Role

As a Staff Applied AI Engineer, you are a cross-functional AI leader and strategic thought partner. This role exists to define Komodo’s long-term AI capabilities, set company-wide technical standards, architect foundational AI systems, and guide teams toward scalable, safe, and innovative AI development. You will influence data strategy, drive build-vs-buy evaluations, and meaningfully shift Komodo’s AI-native infrastructure and culture.

This role includes a specialization in AI observability, evaluation, and production reliability—ensuring systems are not only performant, but measurable, debuggable, and trustworthy in real-world use.

Looking back on your first 12 months at Komodo Health, you will have accomplished…

• Defined strategic AI capabilities aligned to Komodo’s core business and product roadmap.
• Architected reusable AI platforms, frameworks, or orchestration layers adopted across multiple teams.
• Set standards for responsible AI, safety, prompt design, explainability, and bias mitigation.
• Led high-impact AI initiatives that shaped Komodo’s internal and external product strategy.
• Provided deep technical guidance that unblocked complex problems across teams.
• Built internal alignment on AI investment strategy, tooling, governance, and long-term direction.
• Established company-wide standards for AI observability, evaluation, and monitoring across all production systems
• Defined best practices for measuring LLM performance, reliability, and failure modes in real-world environments.

What You’ll Own

• Help design company-wide AI vision, standards, and reference architectures.
• Defining and building foundational AI platforms (e.g., internal agent frameworks, orchestration systems).
• Acting as a multiplier by mentoring teams, running workshops, and driving organizational knowledge sharing.
• Making high-level technical decisions, including evaluating major build-vs-buy choices for platforms and tooling.
• Shaping Komodo’s data strategy from an AI perspective—requirements, quality, orientation, and long-term structure.
• Leading complex applied research initiatives that push Komodo into new AI capability frontiers.
• Ensuring Komodo’s AI systems meet high bars for reliability, accountability, ethics, and transparency.
• Designing and standardizing observability architectures for AI systems, including logging, tracing, evaluation pipelines, and feedback loops.
• Driving organization-wide approaches to detecting and mitigating issues such as hallucinations, model drift, and system degradation.

What You Bring To Komodo Health (required)

• Recognized expert in applied AI with demonstrated impact across multiple teams or organizational domains.
• Extensive experience architecting end-to-end AI systems, multi-agent architectures, and large-scale orchestration frameworks.
• Deep technical sophistication with LLMs, agent safety, responsible AI, observability, and ML lifecycle governance.
• Strong fluency in Python, GenAI frameworks (vLLM, Strands, Crew AI), and full-stack syste