Technical Program Manager

Clera
San Francisco, CA
On-site

Who this role is best for

A natural match if you have experience managing AI/ML data programs and working in fast-paced startups.

Best fit for

  • Candidates with 3+ years managing AI/ML data programs and startup experience as a technical program lead
    — “At least 3 years of experience owning complex technical programs in AI/ML, data operations”
  • Individuals who thrive in ambiguous environments and can structure evolving requirements
    — “record of bringing structure to changing or ambiguous requirements”
  • Professionals with expertise in data quality, annotation workflows, and RLHF environments
    — “Background in RLHF, reinforcement-learning environments, agent evaluations”

Things to consider

  • On-site presence in San Francisco is preferred, with limited remote flexibility
    — “On-site in San Francisco, California. Candidates based remotely may be considered”
  • The role demands handling urgent, evolving needs from research teams
    — “supporting technical customers or research teams with urgent, evolving needs”

How to stand out

  • Highlight your ability to structure ambiguous requirements with clear specifications and milestones
    — “Turn ambiguous technical requests into clear specifications with milestones”
  • Showcase data quality improvements through metrics and individual example reviews
    — “assess aggregate dataset metrics and inspect individual examples”
  • Emphasize experience managing external vendors in scalable delivery pipelines
    — “Manage external vendors through the delivery lifecycle”
  • Demonstrate cross-functional collaboration with research and platform teams
    — “Partner with research, platform, and marketplace teams”
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Turn ambiguous technical requests into clear specifications
Typical background
Experience as a Technical Program Manager or strategic program lead

Skills & requirements

Required

Technical Program ManagementData OperationsVendor CoordinationData Quality ProcessesQuantitative MeasuresQualitative ReviewData ProductionEvaluationWorkflow ImprovementDocumentationAutomationCross-functional HandoffsResearchPlatformMarketplaceProduct ImprovementsData Quality ProceduresExternal Vendor ManagementTechnical Customer SupportResearch Team Support

Preferred

RLHFReinforcement-learning EnvironmentsAgent EvaluationsHuman-in-the-loop Data PipelinesAnnotation WorkflowsExpert Data Collection

Stack & domain

Data OperationsVendor CoordinationData Quality ProcessesQuantitative MeasuresQualitative ReviewData ModelingData ProductionEvaluationAutomationCross-functional HandoffsLLM EvaluationAgent EvaluationsHuman-in-the-loop Data PipelinesAnnotation WorkflowsExpert Data CollectionCommunicationIndependenceFast-paced EnvironmentProblem-solvingTeamworkAI Research

About the role

Original posting from Clera via Ashby

ABOUT THE ROLE

Own complex, time-sensitive data and evaluation programs for AI research teams and internal partners. This role works across technical program management, data operations, and vendor coordination to turn ambiguous requests into reliable programs that improve LLM and agent evaluation.

WHAT YOU'LL DO

  • Lead data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
  • Turn ambiguous technical requests into clear specifications with milestones, owners, dependencies, and acceptance criteria.
  • Improve data quality processes using quantitative measures and qualitative review, including analysis of task coverage, difficulty, and reward distributions.
  • Manage external vendors through the delivery lifecycle and strengthen scalable delivery pipelines.
  • Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
  • Partner with research, platform, and marketplace teams to turn findings into product improvements.

WHAT WE'RE LOOKING FOR

  • At least 3 years of experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a related cross-functional field.
  • Experience as a Technical Program Manager or strategic program lead at a startup, with a record of bringing structure to changing or ambiguous requirements.
  • Strong quantitative and qualitative judgment, including the ability to assess aggregate dataset metrics and inspect individual examples.
  • Experience improving data quality procedures, managing external vendors, and supporting technical customers or research teams with urgent, evolving needs.
  • Background in RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation workflows, or expert data collection is valuable.
  • Strong communication skills and comfort working independently in a fast-paced environment.

COMPENSATION & BENEFITS

Base salary is $130,000 to $225,000 annually. Visa sponsorship and relocation support are available for qualified full-time candidates.

LOCATION

On-site in San Francisco, California. Candidates based remotely may be considered if they can maintain 70% to 80% time zone overlap with San Francisco or Singapore.

Source: Clera careers (Ashby)

Similar roles

More roles at Clera