Principal Applied Scientist – Responsible AI

Cozydesk
Washington, US
Remote

Job Description

At Claritev, we pride ourselves on being a dynamic team of innovative professionals. Our purpose is simple - we strive to bend the cost curve in healthcare for all. Our dedication to service excellence extends to all our stakeholders -- internal and external - driving us to consistently exceed expectations. We are intentionally bold, we foster innovation, we nurture accountability, we champion diversity, and empower each other to illuminate our collective potential.

Be part of our amazing transformational journey as we optimize the opportunity towards becoming a leading technology, data, and innovation voice in healthcare. Onward and Upward!!!

JOB SUMMARY:

The Principal Applied Scientist — Responsible AI is responsible for the design, development, and technical evaluation of AI/ML systems, with a focus on production readiness, model reliability, and technical risk validation. This role serves as the technical authority within the Responsible AI program, ensuring that all AI systems meet defined standards for performance, observability, and risk mitigation prior to production deployment.

Your work directly impacts audit readiness, risk mitigation, and the trustworthiness of AI systems used across the business. This role does not own governance frameworks, policy, or enterprise AI architecture, but ensures that AI systems are technically compliant, measurable, and defensible within those frameworks.

JOB ROLES AND RESPONSIBILITIES:

  • Develop and implement evaluation frameworks for model performance, reliability, and robustness
  • Assess risks including bias, hallucination, data leakage, and system failure modes
  • Provide technical validation for AI systems prior to governance approval
  • Define and validate technical criteria for “production-ready AI”
  • Ensure systems meet required thresholds for deployment (performance, monitoring, controls)
  • Support go/no-go decisions with objective, evidence-based analysis
  • Design and implement model monitoring and evaluation pipelines
  • Define metrics for performance tracking, drift detection, and system health
  • Ensure systems produce traceable, audit-ready outputs
  • Partner across Core AI, Engineering, Product, Legal, and Compliance teams
  • Serve as the technical reviewer in governance and production approval workflows
  • Provide guidance to engineering teams on aligning with governance requirements
  • Research and evaluate emerging AI technologies, including generative AI and agentic systems
  • Prototype and test new approaches aligned with production and governance constraints
  • Contribute to continuous improvement of AI capabilities and standards
  • Mentor applied scientists and data scientists
  • Promote best practices in experimentation, validation, and reproducibility
  • Elevate technical rigor across AI development teams
  • Ensure AI systems comply with defined Responsible AI and governance standards
  • Partner with the AI Governance Architect to operationalize technical requirements
  • Support audit readiness through well-documented technical evidence
  • Manage a portfolio of AI initiatives aligned to Responsible AI and business objectives
  • Provide transparency into pipeline status, technical dependencies, and risks
  • Balance research, development, and production support across multiple concurrent efforts
  • Ensure disciplined execution aligned with governance and production milestones

Apply To This Job

Skills & Requirements

Technical Skills

Ai/ml systemsModel performanceReliabilityRobustnessBiasHallucinationData leakageSystem failure modesAi systemsProduction readinessObservabilityMonitoringMetricsPerformance trackingDrift detectionSystem healthAi governance architectTechnical requirementsAudit readinessTechnical evidenceEmerging ai technologiesGenerative aiAgentic systemsExperimentationValidationReproducibilityTechnical rigorAi development teamsTechnical planningPrioritizationPipeline managementResearchDevelopmentProduction supportGovernance requirementsTechnical dependenciesRisksMilestonesLeadershipCommunicationProblem solvingHealthcareAiMlResponsible ai

Employment Type

FULL TIME

Level

principal

Posted

4/26/2026

Apply Now

You will be redirected to Cozydesk's application portal.

Sign in and we'll score your resume against this role.