Senior Software Engineer, TorchPass Product Engineering

Clockwork.io
On Site +1 more
On-site

Who this role is best for

Geared toward experienced infrastructure engineers comfortable with customer-facing product deployment and support.

Best fit for

  • Candidates with strong production debugging skills and a background in Kubernetes or Slurm
    — “Deep experience with Kubernetes or Slurm”
  • Individuals who thrive in customer-facing roles and can interpret logs and resolve field issues
    — “Work directly with customers and our solutions engineers during evaluations: read logs, separate product defects from environment issues, and say clearly what happened”

Things to consider

  • The role does not require GPU runtime or kernel-level expertise, which may be a limiting factor for some candidates
    — “This is a product and deployment role. It does not require GPU runtime, NCCL, or kernel experience.”

How to stand out

  • Highlight your experience in turning internal systems into production-ready, customer-deployable products
    — “You have taken a system that worked for its authors and made it installable and supportable by people who did not build it”
  • Emphasize your ability to debug and support production systems you did not write
    — “Strong debugging skills on production systems you did not write”
  • Showcase your documentation skills with examples of clear, actionable guides you have created
    — “You write documentation that people follow successfully”
  • Demonstrate your ability to collaborate with customers and translate their feedback into product improvements
    — “Work directly with customers and our solutions engineers during evaluations”
  • Include experience with cluster deployment across multiple cloud providers if applicable
    — “Experience bringing up clusters across more than one cloud provider”
Pace · Fast PacedCollaboration · MediumAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • successful product deployment
  • customer support
Typical background
4+ years of experience in infrastructure software

Skills & requirements

Required

Infrastructure Software DevelopmentProduction DebuggingKubernetes Or SlurmPythonGo

Preferred

GPU ClustersRelease EngineeringMulti-cloud Provider Experience

Stack & domain

Infrastructure SoftwareKubernetesSlurmPythonGoRelease EngineeringGPU ClustersMachine Learning Training InfrastructureDebuggingDocumentationCustomer SupportTeamworkCommunicationProblem-solvingAIDistributed ComputingSoftware Engineering

About the role

Original posting from Clockwork.io via Greenhouse

About Clockwork Systems

Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization

Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering cross-stack observability to catch and quickly resolve problems, workload fault tolerance to keep jobs running through failures, and performance acceleration that dynamically routes and paces traffic to avoid congestion.

To learn more, visit www.clockwork.io.About the Role

TorchPass keeps distributed PyTorch training running through hardware and network failures. The Product Engineering team makes it something customers can install, trust, and run on their own clusters.

We are looking for an experienced engineer who has turned working infrastructure software into a product that other people can deploy and operate. You will own the parts of TorchPass that customers touch, and you will be one of the engineers they hear from when something does not work.

This is a product and deployment role. It does not require GPU runtime, NCCL, or kernel experience.

What You Will Do

Build and own the customer-facing surfaces of TorchPass: installation, configuration, and the views that show customers what the product is doing

Keep product documentation accurate with every release

Work directly with customers and our solutions engineers during evaluations: read logs, separate product defects from environment issues, and say clearly what happened

Turn what we learn in the field into fixes, tests, and documentation

Define, together with the core engineering team, what TorchPass needs from a customer's cluster and what it guarantees in return

Extend TorchPass to new schedulers and job launchers as customers need them

What We're Looking For

4+ years building or operating infrastructure software in production

You have taken a system that worked for its authors and made it installable and supportable by people who did not build it

Strong debugging skills on production systems you did not write

Deep experience with Kubernetes or Slurm

Strong Python, and the ability to read and change Go

You use AI coding tools well, and you understand and stand behind the code you ship

You write documentation that people follow successfully

You are comfortable working with customers on technical problems

A degree in computer science, electrical engineering, or a related field, or equivalent experience

Preferred

Experience with GPU clusters or machine learning training infrastructure

Experience with release engineering: build pipelines, packaging, artifact delivery

Experience bringing up clusters across more than one cloud provider

Enjoy

Challenging projects.

A friendly and inclusive workplace culture.

Competitive compensation.

A great benefits package.

Catered lunch.

Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $150,000 - $230,000. In addition to cash compensation, this role is eligible to participate in the company’s equity program, which may include stock options granted in accordance with the company’s equity plan and subject to approval and applicable vesting schedules.

Clockwork Systems is an equal opportunity employer. We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.

Source: Clockwork.io careers (Greenhouse)

Similar roles