AI Fleet Platform Software Engineer

Cerebras Systems
Sunnyvale +2 more
Hybrid

Who this role is best for

Strong fit for distributed systems engineers who design scalable operational tools and manage large-scale infrastructure, with a preference for candidates experienced in AI clusters and backend systems.

Best fit for

  • Candidates with 12+ years of experience in distributed systems and production software development
    — “12+ years of industry experience building and operating production software for distributed systems or large-scale infrastructure.”
  • Individuals who have led projects from design to production and used feedback for continuous improvement
    — “Lead projects from initial design to production, measure their impact, and use operational feedback to guide improvements.”
  • Engineers who have built systems for handling asynchronous work and partial failures
    — “Experience designing systems that handle asynchronous work, retries, and partial failures.”
  • Professionals with expertise in fleet management systems or control planes
    — “Expertise in control planes, fleet management systems, or operational platforms.”

Things to consider

  • The role demands geographic flexibility between the SF Bay Area and Toronto.
    — “SF Bay Area. Toronto, Canada.”
  • Candidates must be able to work across multiple infrastructure teams and systems.
    — “Partner with Cluster Operations, infrastructure, inference, security, and data center teams.”

How to stand out

  • Highlight experience in building scalable fleet management systems for distributed infrastructure.
    — “Build and operate software for managing large fleets of AI clusters.”
  • Emphasize leadership in ambiguous projects and cross-functional collaboration.
    — “Ability to lead ambiguous projects and work effectively across engineering and operations teams.”
  • Showcase skills in designing backend services and APIs using Go or Python.
    — “Strong Go or Python skills and experience designing services and APIs.”
  • Demonstrate experience with event streaming, workflow automation, or time-series telemetry.
    — “Experience with event streaming, workflow automation, or time-series telemetry.”
  • Demonstrate a track record of automating incident response and improving operational tools.
    — “Automate repetitive work and improve the tools teams use to investigate incidents and restore service.”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Built and operated software for managing large fleets of AI clusters
  • Developed services and integrations that bring together data and workflows from multiple infrastructure systems
  • Automated repetitive work and improved tools for incident investigation and service restoration
Typical background
12+ years of industry experience building and operating production software for distributed systems or large-scale infrastructure

Skills & requirements

Required

Distributed SystemsGo Or PythonAPI DesignLinuxContainersKubernetesAsynchronous WorkRetriesPartial FailuresEvent StreamingWorkflow AutomationTime-series TelemetryReliabilitySecurityObservability

Preferred

Incident ResponseHardware HealthCapacity ManagementDashboardsInfrastructure OperatorsAI ClustersComputeNetworkingHardware Systems

Stack & domain

GoPythonControl PlanesFleet Management SystemsOperational PlatformsLinuxContainersKubernetesEvent StreamingWorkflow AutomationTime-series TelemetryReliabilitySecurityObservabilityCommunicationLeadershipTeamworkProblem-solvingAdaptabilityOwnershipAISoftware EngineeringDistributed SystemsInfrastructureOperations

About the role

Original posting from Cerebras Systems via Ashby

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership https://openai.com/index/cerebras-partnership/ with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

THE ROLE

Cerebras operates AI clusters across a growing number of data centers. As the fleet expands, the software used to monitor and manage it must scale with it. We are seeking a senior software engineer to build the platforms and tools that help our teams understand fleet health, respond to issues, and keep compute capacity available.

You will own substantial engineering work across backend services, operational tools, and user-facing applications. You will partner with Cluster Operations, infrastructure, inference, security, and data center teams to turn real operational challenges into software that works reliably at scale.

RESPONSIBILITIES

  • Build and operate software for managing large fleets of AI clusters
  • Give operators clear, actionable views of cluster health, capacity, performance, and ongoing issues.
  • Develop services and integrations that bring together data and workflows from multiple infrastructure systems.
  • Automate repetitive work and improve the tools teams use to investigate incidents and restore service.
  • Design systems that remain reliable as the fleet grows and continue to function through component and site failures.
  • Work closely with users of the platform to understand their needs and make practical product and engineering decisions.
  • Lead projects from initial design to production, measure their impact, and use operational feedback to guide improvements.

SKILLS AND REQUIREMENTS

  • 12+ years of industry experience building and operating production distributed systems or large-scale infrastructure software.
  • Strong Go skills. You will work with Go, Protocol Buffers, and SQL regularly. Python experience is an added benefit.
  • Experience building control planes, fleet management systems, or operational platforms.
  • Experience designing APIs and data models that serve multiple consumers, with a considered approach to versioning and compatibility.
  • Experience building asynchronous systems that support idempotency, concurrency, and reconciliation while preventing unintended state drift.
  • A strong testing practice, especially for software that can change the state of running production clusters.
  • Experience with Linux, containers, and Kubernetes.
  • Experience with durable workflow execution, event streaming, or time-series telemetry at high cardinality.
  • Sound judgment about reliability, security, and observability, including how a system behaves when its dependencies are unavailable.
  • Ability to take an ambiguous problem from design through production and improve the solution using operational feedback.

PREFERRED EXPERIENCE

  • Building infrastructure software for thousands of hosts across multiple sites.
  • Developing software for incident response, hardware health, or capacity management.
  • Deploying and operating services on AWS.
  • Working with AI or HPC clusters and their compute, networking, and hardware systems.
  • Developing dashboards or applications for infrastructure operators.

LOCATION

  • SF Bay Area.
  • Toronto, Canada.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  • Build a breakthrough AI platform beyond the constraints of the GPU.
  • Publish and open source their cutting-edge AI research.
  • Work on one of the fastest AI supercomputers in the world.
  • Enjoy job stability with startup vitality.
  • Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here https://www.cerebras.ai/join-us!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here https://www.cerebras.net/privacy/ to review our CCPA disclosure notice.

Source: Cerebras Systems careers (Ashby)

Similar roles