Network Engineer (Supercomputer Infrastructure) - Memphis

Xai
Memphis +1 more

Who this role is best for

A natural match if you have experience with high-performance computing networks and a background in data-center infrastructure.

Best fit for

  • Candidates with experience in deploying 400G/800G network hardware and managing AI/HPC fabrics
    — “Evaluate, procure, and deploy network hardware including data-center class switches, NICs, firewalls, optical multiplexers, and related appliances supporting 400G/800G and beyond.
  • Individuals who have worked in mission-critical, large-scale production environments and have a strong sense of urgency
    — “exceptional network engineer with experience in mission-critical, large-scale production environments
  • Candidates with a background in network automation using GitOps and IaC frameworks
    — “Contribute to maturing network automation tooling; implement configuration analysis, linting, validation, and scalable deployment frameworks (GitOps / IaC).
  • Candidates with a history of cross-functional collaboration and systemic design evaluation
    — “Collaborate with cross-functional teams to identify and resolve potential design issues, especially systemic or cascading failure modes.

Things to consider

  • Availability for extended hours and weekends is a key requirement due to compute schedules
    — “Availability for extended hours and/or weekends as the schedule varies with cluster build-out and operational
  • The role demands physical dexterity and ability to work in tight spaces for on-site tasks
    — “Ability to work in tight quarters; physical dexterity is necessary to perform job functions.

How to stand out

  • Highlight experience with network segmentation and compliance with ITAR, ISO, or NIST standards
    — “Ensure networks are configured and maintained in compliance with industry and cybersecurity standards (e.g., ITAR, ISO, NIST)
  • Emphasize hands-on troubleshooting experience in latency-sensitive or industrial environments
    — “Extensive hands-on experience designing, deploying, supporting, and troubleshooting Layer 2 and Layer 3 networks in latency-sensitive and/or industrial / data-center environments.
  • Showcase your ability to publish root cause analysis documentation and host retrospectives
    — “Troubleshoot and resolve network-related issues... publish root cause analysis (RCA) documentation and host retrospectives.
  • Demonstrate experience with fiber plant testing and WDM technologies in your resume
    — “Experience with WDM and large-scale single-mode / multimode fiber plants, including OTDR and acceptance testing.
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • design and implement highly available, low-latency, high-bandwidth networks
  • evaluate and deploy network hardware
  • contribute to network automation tooling
  • troubleshoot and resolve network-related issues
Typical background
network engineeringsupercomputer infrastructureAI training fabrics

Skills & requirements

Required

Network EngineeringSupercomputer InfrastructureAI Training FabricsHigh-bandwidth NetworksNetwork AutomationNetwork Monitoring

Preferred

Ai-native CuriosityGitopsIac

Stack & domain

Network EngineeringAI SupercomputerGPU TrainingInferenceNetwork HardwareNetwork AutomationNetwork MonitoringNetwork DocumentationCross-functional CollaborationCommunicationProblem-solvingTeamworkLeadershipInitiativePrioritizationSupercomputer InfrastructureAINetworking

About the role

Original posting from Xai via Greenhouse

SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

ABOUT THE ROLE:

SpaceXAI is looking for an exceptional network engineer with experience in mission-critical, large-scale production environments to support the design, build-out, and operation of networks that power our AI supercomputer campuses. As a member of the Supercomputer Infrastructure / Network Engineering team, you will provide design and operational support for the fabrics used by GPU training and inference clusters, site operations, automation and controls, and facilities teams. The ideal candidate thrives in intense, high-flux environments, brings a strong sense of urgency balanced with operational excellence, communicates clearly, and demonstrates high technical acumen.

RESPONSIBILITIES:

Design and implement highly available, low-latency, high-bandwidth networks, carefully balancing routing, congestion control, and redundancy technologies for AI training fabrics, inference front-ends, storage, and site/OT networks.

Design and maintain supercomputer data center and campus networks in accordance with company network standards. Collaborate with adjacent infrastructure, compute, storage, SiteOps, and enterprise teams.

Evaluate, procure, and deploy network hardware including data-center class switches, NICs, firewalls, optical multiplexers, and related appliances supporting 400G/800G and beyond.

Contribute to maturing network automation tooling; implement configuration analysis, linting, validation, and scalable deployment frameworks (GitOps / IaC).

Plan and coordinate network change windows with stakeholders to perform software updates, hardware refreshes, cluster expansions, and general maintenance (including evenings and weekends when required by compute schedules).

Troubleshoot and resolve network-related issues affecting cluster health and job performance; publish root cause analysis (RCA) documentation and host retrospectives.

Provide direct networking support during cluster bring-up, expansion, and production training/inference campaigns; serve as on-call or networking responsible engineer during operations.

Proactively tailor network monitoring and telemetry (fabric health, congestion, packet loss, NCCL/collective performance) so issues are detected before they impact training or inference.

Continuously create and update network documentation, including architecture overviews, design drawings, fiber/cable plant records, and operational procedures.

Collaborate with cross-functional teams to identify and resolve potential design issues, especially systemic or cascading failure modes and false redundancy in AI fabrics and site networks.

Perform job walks with customers, vendors, and contractors to gather requirements and produce implementation plans for new halls, rows, and campus interconnects.

Ensure networks are configured and maintained in compliance with industry and cybersecurity standards (e.g., ITAR, ISO, NIST), with particular attention to segmentation between compute fabrics, storage, OT/controls, and corporate networks.

BASIC QUALIFICATIONS:

Bachelor’s degree in computer science, computer engineering, or other STEM discipline and 3+ years of professional network engineering experience;

OR 5+ years of professional network engineering experience in lieu of a degree.

Extensive hands-on experience designing, deploying, supporting, and troubleshooting Layer 2 and Layer 3 networks in latency-sensitive and/or industrial / data-center environments.

Functional experience with multiple network vendors in production or lab environments.

Experience with GitOps and Infrastructure as Code frameworks, both as a user and contributor.

PREFERRED SKILLS AND EXPERIENCE:

Strong understanding of the OSI model and network standards.

Hands-on experience with Cisco, Arista, Juniper, and/or NVIDIA Spectrum-X data-center class switches.

Experience with RoCEv2 Ethernet AI/HPC fabrics; InfiniBand experience is a plus.

Working knowledge of AI training and inference traffic patterns and how they behave on the network (collectives, congestion, ECMP, adaptive routing). Familiarity with NCCL is a plus.

Experience with WDM and large-scale single-mode / multimode fiber plants, including OTDR and acceptance testing.

Experience with switch port security, network segmentation, QoS, multicast, and redundancy protocols.

Familiarity with network monitoring and Layer 1 test tools; experience building operational telemetry and dashboards.

Proficiency in scripting (Bash / PowerShell / Python) and automation frameworks (Terraform, Ansible, etc.).

Linux and Windows system administration experience professionally or from labs.

Industry-standard certifications such as CCNA or CCNP.

Experience supporting real-time systems, industrial control / OT networks, or high-reliability environments in data center, energy, aerospace, defense, or similar industries.

Excellent communication skills with internal and external customers, vendors, and management in both formal and informal settings.

ADDITIONAL REQUIREMENTS:

Ability to pass applicable background checks for site access.

Ability to work in tight quarters; physical dexterity is necessary to perform job functions.

Availability for extended hours and/or weekends as the schedule varies with cluster build-out and operational needs; flexibility is required.

Ability to provide 24x7 on-call support in emergency situations and participate in an after-hours on-call rotation.

Willingness to travel (up to 20%) between supercomputer campuses and related sites.

Ability to lift 30 lbs.

Ability to work at heights.

Ability to drive (active valid driver’s license).

SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.

Source: Xai careers (Greenhouse)

Similar roles