Staff Software Engineer in Test, Compiler & Systems Validation

Code Metal
San Franscisco Hub +2 more
HybridCareer-pivot friendly

Who this role is best for

Systems software experts with compiler or language tooling experience and a focus on validation will find this Staff-level role in quality engineering for AI-assisted workflows.

Best fit for

  • Candidates with 8+ years in systems software and a track record of scaling test frameworks
    — “Typically 8+ years of relevant software engineering, test infrastructure, or quality engineering experience”
  • Individuals with deep knowledge of memory models and cross-platform execution behaviors
    — “Strong understanding of memory models, concurrency, runtime performance, and architecture-dependent behavior”
  • Professionals with hands-on experience in regulated or high-assurance software domains
    — “Professional experience in regulated, safety-critical, or high-assurance domains”

Things to consider

  • US citizenship may be required for certain projects despite remote flexibility
    — “US Citizenship may be required for certain project assig”
  • This role demands building validation practices from the ground up in a new team area
    — “The first dedicated Software Engineer in Test (SDET) hire for this space”

How to stand out

  • Highlight experience with formal verification and translating research into engineering checks
    — “Familiarity with formal verification and experience translating research methods into practical engineering checks”
  • Emphasize your ability to design distributed execution systems for complex software
    — “Experience designing and scaling automated test frameworks, distributed execution systems”
  • Showcase your track record of improving quality practices in high-consequence systems
    — “Experience improving and scaling quality practices for complex, nondeterministic, or high-consequence software systems”
  • Demonstrate your ability to partner with product teams on validation strategies
    — “Strong cross-functional collaboration skills, including partnering with Product”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • establishment of scalable quality strategies
  • improved consistency and coverage in quality practices
Typical background
software engineeringquality assurance

Skills & requirements

Required

Automated TestingRegression TestingQuality AssuranceDebuggingTest Framework Design

Preferred

Formal MethodsAi-assisted Engineering Workflows

Stack & domain

Systems SoftwareCompiler Or Language ToolingDeveloper ToolsEmbedded SoftwareLow-level Execution EnvironmentsPythonC++CRustAutomated Test FrameworksDistributed Execution SystemsEvaluation PipelinesMemory ModelsConcurrencyRuntime PerformanceArchitecture-dependent BehaviorAi-assisted Software WorkflowsFormal MethodsCode-transformation PlatformsLanguage ToolchainsAi-assisted Engineering WorkflowsSound JudgmentReliabilityReproducibilityRiskAppropriate OversightDiagnosing Complex FailuresFocused CorrectionsPartnering With Owning TeamsQuality PracticesStandardizing Quality SignalsRelease EvidenceRegression TrendsFailure AttributionValidation ResultsDocumented Readiness CriteriaIntegrating Validation SuitesQuality GatesDelivery WorkflowsCollaboratingTechnical StandardsMentoring EngineersShaping The Quality Engineering Function’s RoadmapOperating ModelCross-team InterfacesAutomated Software EngineeringAIQuality Engineering

About the role

Original posting from Code Metal via Ashby

ABOUT CODE METAL

Code Metal is the leader in automated software engineering you can trust. As AI writes more of the world's code, the bottleneck in software has shifted from writing code to verifying it works, and AI cannot verify its own work with certainty. Code Metal takes a fundamentally different approach: constrain AI to what it does reliably, verify every step independently of the model using formal methods, and keep engineers in the loop on the decisions that matter. The result isn't code that probably works — it's code that is provably correct, with auditable proof. Customers including the U.S. Air Force, L3Harris, RTX, and Toshiba use Code Metal to modernize legacy code, optimize performance on real hardware, and move prototypes to production, fast. Founded in 2023 with offices in Boston and San Francisco, Code Metal is funded by Accel, Salesforce Ventures, B Capital, Smith Point Capital, J2 Ventures, Shield Capital, Overmatch, RTX, and others.

Learn more at codemetal.ai http://codemetal.ai.

The Role

Code Metal is strengthening Quality Engineering across its code-transformation platforms, language toolchains, and AI-assisted engineering workflows. Our teams already have meaningful validation practices in place. As the first dedicated Software Engineer in Test (SDET) hire for this space, reporting to the Director of Quality Engineering, you will build on those foundations - identifying gaps, establishing scalable practices, improving consistency and coverage, and creating clearer quality signals and trustworthy release evidence in partnership with Engineering, Research, and Solutions.

Core Responsibilities

  • Assess existing validation practices, identify material gaps, and establish scalable quality strategies for code-generation, transpilation, and software-transformation workflows.
  • Strengthen quality practices for AI-assisted and agentic workflows, with sound judgment about reliability, reproducibility, risk, and appropriate oversight.
  • Build automated quality and regression infrastructure for AI-assisted software workflows that produces reproducible engineering evidence.
  • Strengthen and standardize quality signals and release evidence, including regression trends, failure attribution, validation results, and documented readiness criteria.
  • Diagnose complex failures across C/C++, Rust, Python, build systems, generated code, and heterogeneous target environments; make focused corrections where practical and partner with owning teams on deeper fixes.
  • Integrate validation suites and quality gates into delivery workflows while collaborating with, rather than replacing, the team responsible for shared CI/CD and developer infrastructure.
  • Lead quality practices for this space, establish technical standards, mentor engineers, and help shape the Quality Engineering function’s roadmap, operating model, and cross-team interfaces.

Required Qualifications

  • Significant experience in systems software, compiler or language tooling, developer tools, embedded software, or low-level execution environments.
  • Production-grade programming proficiency in Python and C++, plus the ability to read and debug unfamiliar C and Rust code.
  • Experience designing and scaling automated test frameworks, distributed execution systems, or evaluation pipelines for complex systems software.
  • Strong understanding of memory models, concurrency, runtime performance, and architecture-dependent behavior across CPU, GPU, embedded, or other constrained targets.
  • Hands-on experience with Linux, containerized environments, continuous integration platforms, and modern build systems.
  • Ability to translate ambiguous quality risks into measurable validation plans, explain tradeoffs clearly, and lead technical work across team boundaries.
  • Strong cross-functional collaboration skills, including partnering with Product to align validation strategies with the product value proposition and customer expectations.
  • Experience validating AI-assisted or nondeterministic software systems, with sound judgment about AI limitations, reproducibility, independent test evidence, and when deterministic controls or human oversight are required.

Preferred Qualifications

  • Experience improving and scaling quality practices for complex, nondeterministic, or high-consequence software systems.
  • Experience evaluating agentic or AI-assisted systems and translating their risks into practical quality controls.
  • Deep hands-on experience with compilers, language tooling, intermediate representations, ABI compatibility, or cross-language semantic validation.
  • Experience establishing repeatable validation environments and traceable engineering evidence.
  • Familiarity with formal verification and experience translating research methods into practical engineering checks.
  • Professional experience in regulated, safety-critical, or high-assurance domains such as defense, aerospace, automotive, medical devices, industrial systems, or semiconductor platforms.

Experience Level

Typically 8+ years of relevant software engineering, test infrastructure, or quality engineering experience, with demonstrated Staff-level scope and impact. Equivalent depth of experience is valued over a rigid year count.

BENEFITS

  • Pay depends on experience, but we strive to be at the upper end of the salary range
  • Health care plan with 100% premium coverage, including medical, dental, and vision
  • 401k with 5% matching
  • Paid Time Off (uncapped vacation, plus sick and public holidays)
  • Flexible hybrid or remote work arrangement
  • Relocation assistance for qualifying employees

Wage Transparency - The salary range for this role is not a guarantee of compensation or salary, as the final offer amount may vary based on factors including, but not limited to, individual proficiency, skills, experience, and location.

We are an equal opportunity employer. US Citizenship may be required for certain project assignments involving security clearance.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Source: Code Metal careers (Ashby)

Similar roles