Senior Software Engineer, Annotations

Handshake
San Francisco, CA
On-siteCareer-pivot friendly

Who this role is best for

Geared toward candidates with experience in AI data operations and a collaborative leadership style, comfortable with building scalable annotation tools and working in a fast-moving environment.

Best fit for

  • Candidates with 6+ years of experience in building scalable systems and leading high-ownership projects
    — “6+ years of software engineering experience building and operating production systems”
  • Individuals who have led complex projects from concept to production delivery
    — “Lead projects from initial concept through high-quality production delivery”
  • Candidates with a background in AI/ML data pipelines or annotation systems
    — “Familiarity with AI/ML data pipelines, annotation systems, evaluation workflows, or human-in-the-loop products”

Things to consider

  • The role requires strong product judgment and linking technical decisions to business outcomes
    — “Strong product judgment and an ability to connect technical decisions to customer and business outcomes”
  • Candidates must be prepared to work in a high-velocity environment with evolving priorities
    — “Comfort working in a high-velocity environment where priorities and requirements evolve quickly”

How to stand out

  • Emphasize experience in building internal-platform or operations software
    — “Experience building workflow, marketplace, operations, or internal-platform software”
  • Highlight contributions to open source or self-directed technical projects
    — “Contributions to open source or a strong record of self-directed technical projects”
  • Showcase leadership in mentoring and improving team practices
    — “Mentor engineers, raise the quality of code reviews and architecture discussions, and help unblock the team”
  • Demonstrate a quality mindset through examples of testing and debugging practices
    — “A quality mindset: you write maintainable code, test thoughtfully, debug deeply, and address root causes”
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • build and scale operator tooling
  • design workflows and quality-control systems
  • lead projects from concept to delivery
Typical background
6+ years of software engineering experience

Skills & requirements

Required

Software EngineeringDistributed SystemsFull-stack DevelopmentProduct Judgment

Preferred

Ai/ml Data PipelinesHuman-in-the-loop Products

Stack & domain

PythonNode.jsTypeScriptReactPostgreSQLBackend ApisDistributed SystemsAI Data OperationsProduct EngineeringFull-stack DevelopmentCommunicationProblem-solvingTeamworkAdaptabilityCuriosityConfidenceMaturityAIData EngineeringSoftware DevelopmentProduct ManagementOperations

About the role

Original posting from Handshake via Ashby

ABOUT HANDSHAKE

Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know. Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.

About Handshake AI

Human data is the core infrastructure to AI advancement. Frontier AI labs currently improve model capabilities with various data-intensive post-training techniques. We believe that data spend for AI training will increase by 3-5x in the next few years and continue for much longer as models take on new domains. Handshake AI supports all of the frontier AI labs, working on their most complex data at the largest scale.

THE ROLE

We’re looking for a Senior Software Engineer to join our Annotations team and build the systems that power high-quality human data for frontier AI companies. You’ll work at the intersection of product engineering, distributed systems, and AI data operations—designing tools that help operators manage annotation projects, improve task quality, and scale expert workflows.

This is a high-ownership role in a fast-moving environment. You’ll partner closely with product, design, data, operations, and engineering teams to turn ambiguous problems into reliable, intuitive software used across the annotation lifecycle.

WHAT YOU’LL DO

  • Build and scale operator tooling that enables teams to create, manage, prioritize, and audit annotation projects.
  • Design workflows and quality-control systems that improve task accuracy, throughput, and customer outcomes.
  • Develop performant full-stack features using Python, Node.js/TypeScript, React, PostgreSQL, and backend APIs.
  • Establish technical direction for complex projects, balancing speed, maintainability, reliability, and operational needs.
  • Partner with product, design, operations, and data teams to define requirements and ship impactful solutions.
  • Lead projects from initial concept through high-quality production delivery, including rollout, monitoring, and iteration.
  • Mentor engineers, raise the quality of code reviews and architecture discussions, and help unblock the team.
  • Improve engineering processes, testing practices, observability, and operational health across the squad.

YOU HAVE

  • 6+ years of software engineering experience building and operating production systems.
  • Strong proficiency in Python, Node.js, Typescript, React, PostgreSQL, and backend APIs.
  • Experience designing scalable, reliable software and making sound architectural tradeoffs.
  • A track record of owning complex projects from ambiguity through delivery.
  • Strong product judgment and an ability to connect technical decisions to customer and business outcomes.
  • Excellent communication skills and the ability to work effectively with technical and non-technical partners.
  • A quality mindset: you write maintainable code, test thoughtfully, debug deeply, and address root causes.
  • A collaborative leadership style, including experience mentoring engineers and elevating team practices.
  • Comfort working in a high-velocity environment where priorities and requirements evolve quickly.

BONUS POINTS

  • Experience building workflow, marketplace, operations, or internal-platform software.
  • Familiarity with AI/ML data pipelines, annotation systems, evaluation workflows, or human-in-the-loop products.
  • Experience working with distributed teams, expert networks, or high-volume operational processes.
  • Contributions to open source or a strong record of self-directed technical projects.

WE OFFER

Handshake delivers benefits that help you feel supported and thrive at work and in life. Benefits for full-time US employees include:

  • Equity in a fast-growing company
  • 401(k) match, competitive compensation, and financial coaching
  • Medical, dental, and vision coverage
  • Mental health support and a $500 wellness stipend
  • Paid parental leave, fertility benefits, and parental coaching
  • $2,000 annual learning stipend
  • Flexible PTO, 15 holidays, and 2 flex days
  • Internet, commuting support, and free lunch and gym access in our San Francisco office
  • Team outings and referral bonuses

Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers http://joinhandshake.com/careers.

Why join Handshake now:

  • Shape how every career evolves in the AI economy, at global scale, with impact your friends, family and peers can see and feel
  • Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world’s top educational institutions
  • Work together with engineers, scientists, operators, and more from Palantir, Meta, Scale AI, and former YC founders
  • Build a massive, fast-growing business with billions in revenue

Source: Handshake careers (Ashby)

Similar roles