Staff Software Engineer, Perception (R5421)

Shield AI
Washington, DC
On-site

Who this role is best for

Strong fit for senior software engineers who build and deploy vision models in defense applications and collaborate across research and production teams. The role emphasizes technical expertise in 3D vision and model optimization, with a focus on mission-critical systems in the U.S.

Best fit for

  • Senior engineers with experience deploying vision models on embedded hardware and translating research into production systems
    — “Deploy and optimize machine learning models for embedded hardware using technologies such as ONNX, TensorRT
  • Candidates who can balance model performance, robustness, and computational efficiency for real-world autonomous platforms
    — “Translate cutting-edge machine learning research into production-ready capabilities by balancing model performance, robustness, computational efficiency
  • Individuals with a background in computer vision and a track record of working on defense-related AI systems
    — “Develop the next generation of perception capabilities for autonomous systems by combining state-of-the-art machine learning with the proven foundations of computer vision

Things to consider

  • This role requires a SECRET clearance, which may involve a background check and delay in onboarding
    — “Ability to obtain a SECRET clearance
  • Candidates must be prepared to work on mission-critical systems with high reliability expectations
    — “reliable, mission-ready perception capabilities

How to stand out

  • Highlight experience with 3D vision algorithms and embedded model optimization in your resume and interviews
    — “Strong understanding of 3D vision problems/algorithms
  • Emphasize your ability to integrate AI research into production systems with real-world impact
    — “Translate emerging AI capabilities into reliable, production-ready systems
  • Showcase projects involving supervised fine-tuning (SFT) workflows and evaluation frameworks for computer vision
    — “Build scalable data pipelines, supervised fine-tuning (SFT) workflows, and evaluation loops
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · CompanyLevel · Senior

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • designing, training, fine-tuning, and maintaining state-of-the-art vision, vision-language, and vision-language-action models
  • developing benchmarks, testing methodologies, and evaluation frameworks
Typical background
experience in developing and deploying machine learning modelsbackground in computer vision and machine learning

Skills & requirements

Required

Developing And Deploying Advanced Machine Learning ModelsBuilding Scalable Data PipelinesDeploying And Optimizing Machine Learning Models For Embedded HardwareApplying Modern Machine Learning Techniques To Solve Perception And Autonomy ProblemsTranslating Cutting-edge Machine Learning Research Into Production-ready Capabilities

Preferred

Experience With Additional Servicenow Modules Like Hrsd, Or GRC

Stack & domain

Machine LearningComputer VisionVision-language ModelsVision-language-action ModelsObject UnderstandingScene InterpretationMission-relevant Environmental AwarenessData PipelinesSupervised Fine-tuningEvaluation FrameworksDeployment InfrastructureONNXTensorrtHardware-accelerated Inference FrameworksAutonomous SystemsAI SystemsEmbedded HardwareResearch-to-productionCross-functional CollaborationModel EvaluationContinuous ImprovementTeam IntegrationModel Performance MeasurementFailure Mode IdentificationFuture Improvement GuidanceAI ResearchProduction-ready SystemsU.S. And International DefenseOperational Autonomous PlatformsCutting-edge AI SystemsPractical Challenges

About the role

Original posting from Shield AI via Lever

Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube. 

The Hivemind Solutions Perception team develops the next generation of perception capabilities for autonomous systems by combining state-of-the-art machine learning with the proven foundations of computer vision. The team advances how autonomous platforms understand and interpret the world by developing vision, vision-language (VLM), and vision-language-action (VLA) models that tackle core perception challenges such as object understanding, scene interpretation, and mission-relevant environmental awareness. Working at the intersection of research and production, our engineers build the data pipelines, supervised fine-tuning (SFT) workflows, evaluation frameworks, and deployment infrastructure needed to transform cutting-edge AI research into reliable, mission-ready perception capabilities.

In this role, you'll develop and deploy advanced machine learning models that enable autonomous systems to better understand, reason about, and interact with their environment. You'll partner closely with machine learning researchers, autonomy engineers, perception engineers, and platform teams to translate emerging AI capabilities into reliable, production-ready systems for U.S. and international defense customers. This is an ideal opportunity for engineers who enjoy building state-of-the-art AI systems while solving the practical challenges of deploying them on operational autonomous platforms. 

What You'll Do::

Model Development – Design, train, fine-tune, and maintain state-of-the-art vision, vision-language, and vision-language-action models that improve perception and decision-making for autonomous systems. 

Data Pipelines & Model Training – Build scalable data pipelines, supervised fine-tuning (SFT) workflows, and evaluation loops that continuously improve model performance on mission-relevant tasks. 

Model Deployment & Optimization – Deploy and optimize machine learning models for embedded hardware using technologies such as ONNX, TensorRT, and hardware-accelerated inference frameworks. 

Perception & Autonomy Applications – Apply modern machine learning techniques to solve challenging perception and autonomy problems across aerial and other autonomous systems operating in complex, real-world environments. 

Research-to-Production – Translate cutting-edge machine learning research into production-ready capabilities by balancing model performance, robustness, computational efficiency, and operational reliability. 

Cross-functional Collaboration – Partner closely with perception, autonomy, platform, and software engineering teams to integrate machine learning capabilities into mission-ready autonomous systems. 

Model Evaluation & Validation – Develop benchmarks, testing methodologies, and evaluation frameworks to measure model performance, identify failure modes, and guide future improvements. 

Continuous Improvement – Improve training infrastructure, developer tooling, deployment workflows, and model lifecycle management to accelerate experimentation and production delivery. 

Required Qualifications::

Typically requires a minimum of 7 years of related experience with a Bachelor’s degree; or 6 years and a Master’s degree; or 4 years with a PhD; or equivalent work experience.

Expertise of machine learning fundamentals. 

Experience training an deploying ML models for computer vision in a production setting. 

Strong understanding of 3D vision problems/algorithms. 

Experience with machine learning frameworks such as PyTorch and TensorFlow. 

Demonstrated expertise in deploying models using TensorRT and ONNX. 

Proficiency in C++ and Python. 

Strong analytical and problem-solving skills, with the ability to translate research into practical applications. 

Ability to obtain a SECRET clearance 

Preferred Qualifications::

Experience with developing autonomous systems for defense customers. 

Experience with training/finetuning vision-language models, vision-language-action models, and/or world models.  

Contributions to open-source projects in machine learning or computer vision. 

Track record of publications in leading computer vision and robotics conferences and journals (e.g., CVPR, ICCV/ECCV, RAL, ICRA).

#LI-DS-1

#LE

Full-time regular employee offer package:

Pay within range listed + Bonus + Benefits + Equity

Temporary employee offer package:

Pay within range listed above + temporary benefits package (applicable after 60 days of employment)

Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.

###

Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.

Source: Shield AI careers (Lever)

Similar roles