Software Engineer - Network (C++)

Xai
Palo Alto; Seattle, US
On-site

Who this role is best for

Best suited to mid-level C++ engineers with expertise in high-performance networking and distributed systems, working in a hands-on, fast-paced AI infrastructure environment.

Best fit for

  • C++ developers experienced in low-latency networking protocols and large-scale systems.
    — “Deep knowledge of networking protocols (UDP, TCP/IP, RDMA, etc.), distributed systems, and large-scale datacenter fabrics.
  • Engineers who thrive in dynamic environments with evolving technical challenges.
    — “Ability to thrive in a fast-paced, dynamic environment with evolving requirements.
  • Candidates who can own full software lifecycle from design to deployment.
    — “Our engineers own the full lifecycle of their software — from design and implementation to deployment, monitoring, and iteration.

Things to consider

  • Extended hours and weekend work may be required.
    — “Must be willing to work extended hours and weekends as needed.
  • Role involves real-time control of a massive AI supercomputer.
    — “real-time control of one of the largest AI supercomputers on Earth.

How to stand out

  • Demonstrate specific examples of debugging and deploying software at scale.
    — “Experience developing, debugging, and deploying software that runs at scale in real-world systems.
  • Highlight projects involving high-performance computing or resource-constrained environments.
    — “Background in real-time systems, high-performance computing, low-latency networking, or resource-constrained environments.
  • Showcase contributions to architecture decisions through design reviews.
    — “Participate in and lead architecture, design, and code reviews.
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · TeamLevel · Senior

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Developed core networking software for AI supercomputers
  • Led architecture and design reviews
  • Built tools for software development and testing
Typical background
Bachelor’s degree in computer science or related fieldExperience in C++ and distributed systems

Skills & requirements

Required

C++Distributed SystemsHigh-performance NetworkingReal-time SystemsSoftware Development Lifecycle

Preferred

CNetworking ProtocolsDistributed SystemsHigh-performance ComputingLow-latency Networking

Stack & domain

C++CNetworking ProtocolsDistributed SystemsHigh-performance ComputingReal-time SystemsLow-latency NetworkingResource-constrained EnvironmentsCommunicationProblem SolvingAnalytical SkillsEngineering FundamentalsAIDatacenter NetworkGpu ClustersHigh-speed Interconnect Fabric

About the role

Original posting from Xai via Greenhouse

ABOUT xAI

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

ABOUT THE ROLE:

At xAI, we design, build, and operate Colossus from the ground up. This includes the massive GPU clusters, high-speed interconnect fabric, and the software that makes it all work at unprecedented scale. Colossus powers Grok and our frontier AI models with a custom, high-performance datacenter network that delivers ultra-low latency and massive bandwidth across hundreds of thousands of GPUs.

As a Software Engineer on the Colossus Networking team, you will develop the core networking software that maximizes the performance and reliability of our datacenter fabric. Your work will directly impact training efficiency, model convergence, and the speed at which we can push the frontier of AI.

Our engineers own the full lifecycle of their software — from design and implementation to deployment, monitoring, and iteration based on real-world performance at scale. You will solve hard problems in distributed systems, high-performance networking, and real-time control of one of the largest AI supercomputers on Earth.

RESPONSIBILITIES:

Develop routing and traffic-engineering algorithms for the Colossus high-performance datacenter network.

Develop highly reliable, real-time software designed to run on the switches that form the backbone of our low-latency, high-bandwidth AI training fabric.

Participate in and lead architecture, design, and code reviews.

Develop prototypes and run experiments to validate key design decisions at both small and full-cluster scale.

Build tools for software development, deployment, data analysis, visualization, and testing across virtualized environments, hardware-in-the-loop setups, and live production clusters.

Deploy reliable software updates through continuous integration and release systems with rigorous testing and monitoring.

BASIC QUALIFICATIONS:

Bachelor’s degree in computer science, engineering, math, or a related technical discipline; OR 2+ years of professional software development experience in lieu of a degree.

Strong development experience in C or C++.

PREFERRED SKILLS AND EXPERIENCE:

Strong professional experience writing high-performance C/C++ in production environments.

Experience developing, debugging, and deploying software that runs at scale in real-world systems.

Deep knowledge of networking protocols (UDP, TCP/IP, RDMA, etc.), distributed systems, and large-scale datacenter fabrics.

Background in real-time systems, high-performance computing, low-latency networking, or resource-constrained environments.

Creative problem-solving ability with exceptional analytical skills and strong engineering fundamentals.

Excellent written and verbal communication skills.

Ability to thrive in a fast-paced, dynamic environment with evolving requirements.

Experience with security considerations in large-scale distributed systems.

ADDITIONAL REQUIREMENTS:

Must be willing to work extended hours and weekends as needed.

COMPENSATION AND BENEFITS

$180,000 - $440,000 USD

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

xAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Source: Xai careers (Greenhouse)

Similar roles