Junior Technical Program Manager — Infrastructure Operations

Together AI
San Francisco, US
On-site

Who this role is best for

Geared toward early-career technical program managers comfortable with fast-paced, high-stakes infrastructure operations in a hybrid Bay Area setting.

Best fit for

  • Candidates who thrive in ambiguous, high-stakes operational environments
    — “The environment moves fast and doesn't always come with a clear playbook
  • Technical operators who can drive cross-functional resolution under pressure
    — “Drive node remediation to resolution with urgency, eliminating gaps in ownership
  • Action-oriented problem solvers comfortable with novel technical challenges
    — “Much of what you'll work on is genuinely novel

Things to consider

  • Hybrid work arrangement requires Bay Area presence
    — “This is a hybrid role based in the Bay Area
  • High-pressure environment with rapid response expectations
    — “Drive node remediation to resolution with urgency

How to stand out

  • Demonstrate concrete examples of owning technical programs end-to-end
    — “Owning programs end-to-end, driving cross-functional resolution
  • Showcase experience building operational visibility through dashboards
    — “Build dashboards and tracking processes that make efficiency gaps visible
  • Highlight technical collaboration with infrastructure teams
    — “Earn credibility with infrastructure engineers
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · TeamLevel · Junior

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • end-to-end node lifecycle management
  • efficient operational workflows
  • visible and accountable operations
Typical background
technical program managementinfrastructure operations

Skills & requirements

Required

Technical Program ManagementCross-functional CoordinationProject TimelinesDatacenter OperationsProcess ImprovementAutomation

Preferred

GPU Fleet ManagementInfrastructure EngineeringDatacenter Bring-ups

Stack & domain

Technical Program ManagementDatacenter OperationsGpu Fleet ManagementInfrastructure EngineeringLightweight AutomationCross-functional CoordinationProblem-solvingCommunicationTeamworkAdaptabilityResilienceLeadershipAIGpuDatacenterInfrastructure

About the role

Original posting from Together AI via Greenhouse

About the Role

Together AI runs one of the most demanding GPU fleets in the industry. Keeping that fleet healthy - every node online, every GPU performing, every datacenter transition running on schedule - is operationally complex and genuinely high-stakes. We're looking for a Junior TPM to own that operational reality.

This is not a coordination or status-reporting role. You will own the end-to-end node lifecycle - from the moment a node goes down through repair, return, and re-integration - and you'll drive the cross-functional work to close every gap as fast as possible. You'll manage datacenter bring-ups, hunt down GPU utilization loss, and build the processes and dashboards that make our fleet operations more visible and accountable over time.

The environment moves fast and doesn't always come with a clear playbook. Much of what you'll work on is genuinely novel - you'll be figuring things out alongside engineers who are building at the frontier. If that sounds like an obstacle, this isn't the right role. If it sounds like the best possible way to learn, keep reading.

Responsibilities

Own the end-to-end node lifecycle - from failure through repair, return, and re-integration — across provider ticketing, internal tooling, and the state machine that governs each stage

Drive node remediation to resolution with urgency, eliminating gaps in ownership at every handoff

Manage project timelines for new datacenter bring-ups, coordinating across internal teams and external providers to keep milestones on track

Identify and diagnose GPU utilization loss across the fleet, working with engineering leads to drive resolution

Build dashboards and tracking processes that make efficiency gaps visible and ensure they get closed

Continuously improve operational workflows through process improvements and lightweight automation

Develop and maintain relationships with external datacenter providers

Requirements

Some prior experience in a TPM role - we're open to candidates who came into TPM from engineering, ops, or another technical function, but you should have done the work in practice: owning programs end-to-end, driving cross-functional resolution, managing external dependencies

A technical background or demonstrated experience in a highly technical environment - you don't need to know GPUs on day one, but you need to be able to engage meaningfully with technical problems and earn credibility with infrastructure engineers

A genuine bias toward action - you see a problem and start moving, even when the path forward isn't fully clear

Resilience in a fast-paced, sometimes chaotic environment - you adapt quickly, stay effective under pressure, and don't wait for perfect conditions to make progress

Strong organizational instincts - you can manage multiple workstreams, track dependencies, and keep things moving without losing the thread

Ability to zoom out - you can be deep in the weeds on an operational problem while keeping the bigger picture in view

About Together AI

Together AI is a research-driven artificial intelligence company. We believe open and transparent AI systems will drive innovation and create the best outcomes for society, and together we are on a mission to significantly lower the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama. We invite you to join a passionate group of researchers in our journey in building the next generation AI infrastructure.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $150,000 - $175,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge. This is a hybrid role based in the Bay Area.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

 

Source: Together AI careers (Greenhouse)

Similar roles