GPU Systems Engineer

Hudson River Trading
Austin +3 more
Hybrid

Who this role is best for

A natural match if you have experience in large-scale GPU cluster optimization and Linux systems engineering.

Best fit for

  • Candidates with a background in optimizing distributed GPU workloads for HPC and AI environments
    — “Design, build, and optimize large-scale distributed GPU compute clusters”
  • Professionals with strong automation and system deployment expertise in Linux-based infrastructure
    — “Automate system deployment, monitoring, and troubleshooting across thousands of nodes”
  • Individuals who thrive in collaborative, high-impact environments with diverse technical teams
    — “able to collaborate across diverse technical teams”

Things to consider

  • The role requires a strong ability to diagnose system issues at multiple technical layers
    — “Comfortable diagnosing complex system issues at the hardware, OS, and network levels”
  • Candidates must be prepared to work with globally distributed teams and infrastructure
    — “globally distributed data centers”

How to stand out

  • Highlight experience with GPU optimization and performance tuning in your resume and interview stories
    — “Deep knowledge around GPU optimization and performance”
  • Demonstrate hands-on experience with Linux system installation and performance tuning
    — “Extensive experience in Linux system installation, performance tuning, and troubleshooting”
  • Showcase projects involving automation frameworks like Ansible or Salt in your application materials
    — “Familiarity with configuration management tools (e.g. Salt, Ansible, Puppet, Chef)”
  • Emphasize your ability to troubleshoot distributed GPU workloads across multiple layers
    — “Identify and resolve GPU workloads’ performance bottlenecks across compute, storage, and networking layers”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · Company

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Designing and optimizing large-scale GPU compute clusters
Typical background
Experience in large-scale Linux systems engineering, HPC, or distributed infrastructure

Skills & requirements

Required

Linux Systems EngineeringGPU OptimizationPerformance TuningAutomation FrameworksNvidia TechnologiesConfiguration Management Tools

Preferred

CUDAC/c++

Stack & domain

Linux Systems EngineeringHpc/aiDistributed InfrastructureGPU Compute ClustersPerformance TuningTroubleshootingAutomation FrameworksPython ScriptingCUDAC/c++Nvidia TechnologiesConfiguration Management ToolsDiagnosing Complex System IssuesCommunicationOrganizational SkillsCollaborationFast-paced EnvironmentsHigh-impact WorkHPCAI

About the role

Original posting from Hudson River Trading

Hudson River Trading (HRT) is looking for GPU Systems Engineers to help scale and evolve our exceptionally sophisticated HPC/AI research environment. 

Joining our Research and Development team, you will collaborate with experts responsible for the compute, storage, operating systems, and automation tools that enable our trading and research to run 24/7 across the globe. We design, grow, and operate infrastructure at a large scale, including exabyte-scale storage and massive CPU and GPU clusters in globally distributed data centers. As such, this is a high-impact role with broad scope, from HPC/AI cluster design and performance tuning, to troubleshooting and automation for thousands of nodes.

Responsibilities

Design, build, and optimize large-scale distributed GPU compute clusters

Identify and resolve GPU workloads’ performance bottlenecks across compute, storage, and networking layers

Collaborate with research and development teams to profile, benchmark, and fine-tune GPU-based workloads

Automate system deployment, monitoring, and troubleshooting across thousands of nodes

Collaborate with research, and engineering teams to support evolving workloads

Own critical infrastructure projects — from concept to implementation and support

Test and deploy new hardware and software, and partner with vendors to resolve complex issues

Qualifications 

5+ years of experience in large-scale Linux systems engineering in HPC, AI or distributed infrastructure roles.

Extensive experience in Linux system installation, performance tuning, and troubleshooting

Expertise in troubleshooting distributed GPU workloads

Deep knowledge around GPU optimization and performance  

Proficiency in Python scripting and automation frameworks 

CUDA or C/C++ experience is a plus

Experience with NVIDIA technologies beyond CUDA, such as NCCL, GPUDirect RDMA, and NVLink 

Familiarity with configuration management tools (e.g. Salt, Ansible, Puppet, Chef)

Comfortable diagnosing complex system issues at the hardware, OS, and network levels

Strong communication and organizational skills; able to collaborate across diverse technical teams

Thrive in fast-paced environments and excited by high-impact work

The estimated base salary range for this position is 150,000 to 300,000 USD per year (or local equivalent). The base pay offered may vary depending on multiple individualized factors, including location, job-related knowledge, skills, and experience. This role will also be eligible for discretionary performance-based bonuses and a competitive benefits package.

Culture

Hudson River Trading (HRT) brings a scientific approach to trading financial products. We have built one of the world's most sophisticated computing environments for research and development. Our researchers are at the forefront of innovation in the world of algorithmic trading.

At HRT we welcome a variety of expertise: mathematics and computer science, physics and engineering, media and tech. We’re a community of self-starters who are motivated by the excitement of being at the cutting edge of automation in every part of our organization—from trading, to business operations, to recruiting and beyond. We value openness and transparency, and celebrate great ideas from HRT veterans and new hires alike. At HRT we’re friends and colleagues – whether we are sharing a meal, playing the latest board game, or writing elegant code. We embrace a culture of togetherness that extends far beyond the walls of our office.

Feel like you belong at HRT? Our goal is to find the best people and bring them together to do great work in a place where everyone is valued. HRT is proud of our diverse staff; we have offices all over the globe and benefit from our varied and unique perspectives. HRT is an equal opportunity employer; so whoever you are we’d love to get to know you.

Please be advised: Use of AI tools by an applicant during interviews or assessments is strictly prohibited, unless otherwise instructed or agreed upon. We employ various methods to evaluate the authenticity of candidate responses. If we determine that AI assistance was used by an applicant during an interview or an assessment, we reserve the right to immediately end the interview or assessment, disqualify the applicant’s candidacy and/or rescind any job offers extended.

You can review our Global Applicant Privacy Notice, which explains how we process applicant information.

Source: Hudson River Trading careers

Similar roles