Member of Technical Staff - Datacenter Networking

Prime Intellect
San Francisco, CA
Remote

Who this role is best for

Strong fit for datacenter networking professionals who design and deploy high-performance GPU infrastructure and have experience with InfiniBand or RoCE.

Best fit for

  • Candidates with experience designing and deploying GPU training and inference networks
    — “Design and deploy scalable datacenter network topologies for GPU training, inference, storage, and management traffic”
  • Individuals who have operated large-scale, high-speed datacenter fabrics
    — “Experience operating 400G/800G networks or large multi-rack GPU clusters”
  • Professionals who can translate ML workload needs into measurable network criteria
    — “Benchmark end-to-end network performance with infrastructure and ML teams, translating workload needs into measurable acceptance criteria”

Things to consider

  • Requires hands-on network troubleshooting across physical and virtual layers
    — “Experience troubleshooting network problems across Linux hosts, NICs, switches, and physical links”
  • Compensation range is high but equity incentives may require long-term commitment
    — “Cash compensation range of $150,000–$300,000 plus equity incentives”

How to stand out

  • Highlight experience with network automation using Python or Ansible in your resume and interviews
    — “Ability to automate network operations with Python, Ansible, or comparable tools”
  • Showcase your ability to work with ML teams on performance benchmarking
    — “Benchmark end-to-end network performance with infrastructure and ML teams”
  • Demonstrate your knowledge of RDMA, congestion control, and lossless Ethernet
    — “RDMA concepts and performance tuning; congestion control and lossless Ethernet considerations”
  • Include experience with leaf-spine architectures and BGP in your technical profile
    — “Leaf-spine architectures, BGP, ECMP, VLANs, and network segmentation”
Pace · SteadyCollaboration · MediumAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Designing scalable network topologies
  • Improving network reliability and performance
  • Building monitoring systems
Typical background
Experience in datacenter networkingHigh-performance GPU networking

Skills & requirements

Required

Datacenter NetworkingGPU TrainingNetwork TroubleshootingAutomationNetwork Provisioning

Preferred

InfinibandRoceLinux Networking

Stack & domain

EthernetTcp/ipRoutingSwitchingRedundant Network DesignHigh-performance GPU NetworkingInfinibandRoceLinux NetworkingNIC DriversPacket CaptureThroughput/latency TestingOpticsTransceiversCable ManagementDatacenter NetworkingGPU Infrastructure

About the role

Original posting from Prime Intellect via Ashby

OWN YOUR INTELLIGENCE

Prime Intellect is building the open superintelligence stack: the infrastructure frontier AI labs build internally, made available to every ambitious AI team.

Our platform, Lab, unifies compute, environments, evaluations, secure sandboxes, high-performance training, and deployment into one full-stack system for post-training at frontier scale - from SFT and RL to tool use, agent workflows, and continuously improving production models. We are building open frontier AI: open-source models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to build them. The next generation of AI companies, enterprises, and research teams do not just need more GPUs. They need the ability to turn their own workflows, tools, data, and feedback loops into superintelligence they own.

Prime Intellect has raised $150M in total funding from Founders Fund, Radical Ventures, NVIDIA, and exceptional AI, infrastructure, and enterprise operators, including Andrej Karpathy, Dwarkesh Patel, and leaders and founders from Ramp, Perplexity, Harvey, Mercor, Zapier, Datadog, Cognition, OpenAI, Thinking Machines, Together AI, SemiAnalysis, LangChain, Browserbase, Cloudflare, Sierra, Databricks, Airbnb, OpenRouter, Standard Intelligence, Fleet, Core Auto, and more. We are looking for people who want to build at the intersection of frontier research, real infrastructure, and go-to-market for a category that does not fully exist yet.

ROLE IMPACT

You'll design and operate the networks that connect large GPU clusters. Own the reliability and performance of training fabrics, storage networks, and management connectivity so distributed workloads can scale without the network becoming the bottleneck.

CORE TECHNICAL RESPONSIBILITIES

  • Design and deploy scalable datacenter network topologies for GPU training, inference, storage, and management traffic
  • Configure and operate high-performance Ethernet/RoCE and InfiniBand fabrics with clear standards for routing, redundancy, and capacity
  • Automate network provisioning, configuration validation, upgrades, and rollback procedures
  • Diagnose packet loss, congestion, link failures, and collective communication performance across hosts and switches
  • Benchmark end-to-end network performance with infrastructure and ML teams, translating workload needs into measurable acceptance criteria
  • Build monitoring for port health, errors, utilization, congestion, and fabric topology; improve incident response and runbooks
  • Partner with datacenter operators and hardware vendors on cabling, optics, deployment readiness, and failure resolution

TECHNICAL REQUIREMENTS

REQUIRED EXPERIENCE

  • 3+ years of production datacenter networking experience
  • Strong understanding of Ethernet, TCP/IP, routing, switching, and redundant network design
  • Hands-on experience with high-performance GPU networking using InfiniBand or RoCE
  • Experience troubleshooting network problems across Linux hosts, NICs, switches, and physical links
  • Ability to automate network operations with Python, Ansible, or comparable tools

INFRASTRUCTURE SKILLS

  • Leaf-spine architectures, BGP, ECMP, VLANs, and network segmentation
  • RDMA concepts and performance tuning; congestion control and lossless Ethernet considerations
  • Linux networking, NIC drivers and firmware, packet capture, and throughput/latency testing
  • Optics, transceivers, cable management, and link-level diagnostics
  • Safe change management, configuration versioning, telemetry, and alerting

NICE TO HAVE

  • Experience operating 400G/800G networks or large multi-rack GPU clusters
  • NVIDIA Spectrum or Quantum networking experience
  • NCCL performance analysis and distributed training troubleshooting
  • EVPN/VXLAN, SONiC, or network source-of-truth systems
  • Experience with network simulation, automated validation, and capacity planning

GROWTH OPPORTUNITY

You'll work directly with customers pushing the boundaries of AI, from startups training foundation models to enterprises deploying massive inference infrastructure. You'll collaborate with our world-class engineering team while having direct impact on systems powering the next generation of AI breakthroughs.

We value expertise and customer obsession - if you're passionate about building reliable, high-performance GPU infrastructure and have a track record of successful large-scale deployments, we want to talk to you.

Apply now and join us in our mission to democratize access to planetary scale computing.

COMPENSATION

Cash compensation range of $150,000–$300,000 plus equity incentives.

Source: Prime Intellect careers (Ashby)

Similar roles