State Estimation Engineer - Data Collection Systems

Figure AI
San Jose, CA

Who this role is best for

Aimed at mid-level engineers with strong sensor fusion and state estimation expertise who can work in-office full-time on dynamic robotics systems.

Best fit for

  • Mid-level engineers with 4+ years of sensor fusion experience in robotics or related fields
    — “4+ years of experience building multi-sensor fusion and state estimation solutions for dynamic hardware systems.
  • Candidates who have developed both real-time and batch optimization algorithms for robotic systems
    — “Design and implement dual-tier state estimation algorithms in modern C++: low-latency, real-time filters for streaming teleoperation and batch optimization/smoothing routines for high-accuracy offline dataset generation.
  • Individuals with a background in human biomechanics or skeletal tracking
    — “Background in human biomechanics, skeletal tracking, or body-mounted telemetry systems.

Things to consider

  • Requires full-time in-office presence with no remote flexibility mentioned
    — “require 5 days/week in-office collaboration.
  • Candidates must be prepared to work with both C++ and Python for different system layers
    — “Proven ability to write high-performance, modular C++ for embedded or edge computing platforms alongside Python for data analysis and visualization.

How to stand out

  • Emphasize your ability to create intuitive calibration routines for users
    — “Own and develop subject-calibration procedures, designing rapid, intuitive routines to estimate individual body segment dimensions, joint offsets, and sensor-to-body extrinsics whenever a user equips the system.
  • Demonstrate your mathematical foundation in 3D spatial kinematics and optimization
    — “Deep mathematical foundation in 3D spatial kinematics, Lie groups (SE(3), SO(3)), forward/inverse kinematics, and constrained optimization.
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · TeamLevel · Mid Level

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • design and implement dual-tier state estimation algorithms
  • develop robust sensor fusion architectures
  • address spatiotemporal sensor calibration
  • develop techniques to extract useful information from compliant tactile sensing
  • diagnose and understand limitations of existing hardware or designs
Typical background
software engineeringroboticsAI

Skills & requirements

Required

State EstimationSensor FusionCalibrationAlgorithm DevelopmentData Collection SystemsReal-time FiltersBatch OptimizationSensor-to-body ExtrinsicsTactile SensingDiagnostic ToolingValidation PipelinesError Analysis

Preferred

TeleoperationHapticsHuman-in-the-loop Control SystemsHuman BiomechanicsSkeletal TrackingBody-mounted Telemetry SystemsMachine Learning Techniques For Motion PriorsTrajectory SmoothingLearned State Estimation/calibration

Stack & domain

State EstimationSensor FusionC++PythonReal-time FiltersBatch OptimizationFactor GraphsGtsamCeresNon-linear Least SquaresTactile SensingCompliant Tactile SensingHuman BiomechanicsSkeletal TrackingBody-mounted Telemetry SystemsMachine Learning (ML)Problem-solvingCommunicationTeamworkAdaptabilityCustomer ServiceStrategic PlanningAI RoboticsHumanoid RobotsTeleoperationTrajectory ReconstructionData CollectionPolicy Training

About the role

Original posting from Figure AI via Greenhouse

Figure is an AI Robotics company autonomous general-purpose humanoid robots. The goal of the company is to ship humanoid robots with human level intelligence. Its robots are engineered to perform a variety of tasks in the home and commercial markets. We are based in North San Jose, CA and require 5 days/week in-office collaboration. It’s time to build.

We are looking for a State Estimation Engineer to own the architecture, algorithm development, and calibration workflows for a next-generation data collection system. This system powers two core capabilities: low-latency real-time teleoperation of our humanoid robots and ultra-high-precision offline trajectory reconstruction for data collection and policy training. You will build and deploy dual-tier estimation pipelines and user-onboarding calibration routines that fuse heterogeneous sensor modalities to track full-body human kinematics and floating-base motion across dynamic tasks.

Key Responsibilities:

Design and implement dual-tier state estimation algorithms in modern C++: low-latency, real-time filters for streaming teleoperation and batch optimization/smoothing routines for high-accuracy offline dataset generation.

Own and develop subject-calibration procedures, designing rapid, intuitive routines to estimate individual body segment dimensions, joint offsets, and sensor-to-body extrinsics whenever a user equips the system.

Develop robust sensor fusion architectures combining spatial transforms, visual-inertial data, and inertial signals into full-body kinematic pose estimates.

Address spatiotemporal sensor calibration, dynamic environmental interference, and kinematic constraint enforcement on human skeletal models.

Develop techniques to extract useful information from compliant tactile sensing in the presence of large sensor deformation, stretching or folding.

Diagnose and understand limitations of existing hardware or designs and inform future design requirements.

Evaluate novel sensing modalities to inform future hardware designs.

Build diagnostic tooling, validation pipelines, and error analysis workflows to evaluate accuracy for both online and offline algorithms.

Requirements:

4+ years of experience building multi-sensor fusion and state estimation solutions for dynamic hardware systems.

Hands-on expertise with both real-time filtering techniques ((E)KFs, sliding-window estimators) and offline batch optimization tools (Factor Graphs, GTSAM, Ceres, Non-Linear Least Squares).

Proven capability to design fast, reliable calibration, zeroing, and alignment workflows for multi-sensor suites and kinematic models.

Deep mathematical foundation in 3D spatial kinematics, Lie groups (SE(3), SO(3)), forward/inverse kinematics, and constrained optimization.

Proven ability to write high-performance, modular C++ for embedded or edge computing platforms alongside Python for data analysis and visualization.

Bonus Qualifications:

Experience with low-latency streaming pipelines for teleoperation, haptics, or human-in-the-loop control systems.

Background in human biomechanics, skeletal tracking, or body-mounted telemetry systems.

Prior experience applying Machine Learning (ML) techniques to motion priors, trajectory smoothing, or learned state estimation/calibration.

The US base salary range for this full-time position is between $150,000 and $300,000 annually.

The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience. The total compensation package may also include additional components/benefits depending on the specific role. This information will be shared if an employment offer is extended. 

Source: Figure AI careers (Greenhouse)

Similar roles