Founding Engineer, Environments and Data

Clera
San Francisco, CA
On-site

Who this role is best for

Aimed at mid-level or senior engineers or researchers with experience in synthetic data and AI evaluation, who are comfortable with simulation and benchmark design.

Best fit for

  • Candidates with experience designing synthetic environments for AI agents and evaluating their performance
    — “Design synthetic company environments with realistic email, records, and files for agents to use over extended tasks.”
  • Engineers or researchers with a background in simulation of complex software tools for agent use
    — “Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.”

Things to consider

  • On-site presence in San Francisco is required for five days a week.
    — “On-site five days a week in San Francisco, California, United States.”
  • This role is research-oriented, not purely infrastructure or engineering focused.
    — “This is a research-oriented role, not solely infrastructure engineering.”

How to stand out

  • Highlight experience with synthetic data pipelines and benchmark design in your resume and interviews.
    — “Hands-on AI research or engineering experience with synthetic data pipelines, benchmarks, evaluations, or post-training.”
  • Showcase your ability to identify and fix evaluation failure modes such as reward hacking.
    — “Find and address evaluation failure modes, including reward hacking and benchmark gaming.”
Pace · Fast PacedCollaboration · MediumAutonomy · HighDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Design and implement evaluation environments for AI agents
  • Develop benchmarks for AI performance
Typical background
Mid-level or senior engineering or research experienceHands-on AI research or engineering experience

Skills & requirements

Required

AI ResearchSynthetic Data PipelinesBenchmark DesignAgent SystemsEvaluation Systems

Preferred

Startup ExperienceHigh-level Competition Experience

Stack & domain

AI ResearchEngineeringSynthetic Data PipelinesBenchmarksEvaluationsPost-trainingAgent GradersEvaluation SystemsSoftware ToolsReward HackingBenchmark GamingAI EvaluationBenchmark DesignSimulationAgent SystemsCollaborativeAdaptableEffectiveAI

About the role

Original posting from Clera via Ashby

ABOUT THE ROLE

Build evaluation environments and benchmarks that measure whether AI agents can perform real-world company work and match or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, with work that shapes how agent competence is measured.

WHAT YOU'LL DO

  • Design synthetic company environments with realistic email, records, and files for agents to use over extended tasks.
  • Build graders and evaluation systems that can reliably assess advanced AI agents.
  • Develop benchmarks that correlate with real-world production performance.
  • Find and address evaluation failure modes, including reward hacking and benchmark gaming.
  • Simulate software tools such as inboxes and CRMs with enough fidelity to support agent interactions at scale.

WHAT WE'RE LOOKING FOR

  • Mid-level or senior engineering or research experience, including at least 1 to 2 years at a fast-growing or AI-focused startup.
  • Hands-on AI research or engineering experience with synthetic data pipelines, benchmarks, evaluations, or post-training. This is a research-oriented role, not solely infrastructure engineering.
  • Experience building environments or benchmarks used to train or evaluate agents, and designing and implementing agent graders or evaluation systems.
  • Experience simulating complex software systems for agent tool use, identifying flaws in established benchmarks, and detecting and fixing reward hacking.
  • Background in AI evaluation, benchmark design, simulation, agent systems, or related areas. Startup founding or accelerator experience and high-level competition experience in mathematics, programming, debate, or games are valued.
  • Collaborative, adaptable, and effective in a fast-moving environment.

COMPENSATION & BENEFITS

Base salary is $200,000 to $300,000 annually, with up to $350,000 for exceptional candidates. Additional commission-style bonus compensation of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is included. Visa sponsorship is available.

LOCATION

On-site five days a week in San Francisco, California, United States.

Source: Clera careers (Ashby)

Similar roles

More roles at Clera