Machine Learning Infrastructure Engineer, Technology

Point72
New York, NY
On-site

Who this role is best for

Strong fit for engineers who design and optimize distributed systems for machine learning and AI workloads, with a focus on cloud infrastructure and collaboration across research and engineering teams.

Best fit for

  • Candidates with 3–7 years of experience in scalable ML infrastructure and cloud platforms like AWS or Azure
    — “3–7 years of experience building and maintaining scalable compute or machine learning infrastructure systems”
  • Individuals skilled in container orchestration and infrastructure-as-code for ML deployment pipelines
    — “Develop and automate deployment, orchestration, and CI/CD pipelines for models and data workflows using container orchestration and infrastructure-as-code (IaC)”
  • Professionals who can bridge ML research and production through systems thinking and collaboration
    — “Collaborate with ML researchers and engineers to produce models, optimizing compute utilization, training throughput, and inference latency”

Things to consider

  • The role demands expertise in both GPU and CPU optimization, which may require specific hardware experience
    — “Troubleshoot, profile, and optimize performance across GPU and CPU compute stacks”
  • Candidates must be prepared to implement and manage security and compliance for GenAI infrastructure
    — “Drive security, compliance, and operational runbooks for GenAI infrastructure”

How to stand out

  • Highlight experience with observability and cost management in GPU environments on your resume
    — “Implement observability, monitoring, and cost-management strategies for GPU and accelerator compute environments”
  • Showcase your ability to mentor and document architecture for ML infrastructure
    — “Document architecture, operational practices, and mentor engineers to expand team capability”
  • Emphasize hands-on work with tools like Kubernetes, Terraform, and MLflow in your interview narrative
    — “Hands-on experience with machine learning operations and infrastructure tools such as MLflow, Ray, Airflow, Kubeflow, and Terraform”
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Design and implement high-performance infrastructure for ML workloads
  • Evaluate and integrate emerging technologies
Typical background
3-7 years of experience building and maintaining scalable compute or ML infrastructure systems

Skills & requirements

Required

Machine Learning InfrastructureDistributed SystemsContainer OrchestrationObservabilityCost Management

Preferred

AI SolutionsCloud Platforms

Stack & domain

PythonGoC++RustKubernetesAWSGoogle Cloud PlatformAzureMlflowRayAirflowTerraformGPUCPUObservabilityMonitoringCost-optimizationAICloudInfrastructureMachine Learning

About the role

Original posting from Point72 via Greenhouse

Machine Learning Infrastructure Engineer 

A Career with Point72’s Technology Team

As Point72 reimagines the future of investing, our Technology team is constantly evolving our firm’s IT infrastructure and engineering capabilities, positioning us at the forefront of a rapidly evolving technology landscape. We’re a team of experts who experiment and work to discover new ways to harness open-source solutions, modern cloud architectures, and sophisticated Artificial Intelligence (AI) solutions, while embracing enterprise agile methodologies. Our commitment to building and innovating in the AI space provides the framework intended to drive smarter decision making and enhance how we build and operate our platforms and applications.

As a member of Point72’s Technology team, we encourage and support your professional development from day one—helping you advance your technical skills, contribute innovative ideas, and satisfy your own intellectual curiosity—all while delivering real business impact for our multi-billion-dollar global business. 

What you’ll do

Design and implement high-performance infrastructure to support large-scale generative AI and machine learning workloads, enabling faster model iteration and real business impact

Design and operate distributed systems for model training, hyperparameter tuning, inference, and data preprocessing pipelines to deliver reliable end-to-end machine learning (ML) workflows

Collaborate with ML researchers and engineers to produce models, optimizing compute utilization, training throughput, and inference latency

Develop and automate deployment, orchestration, and CI/CD pipelines for models and data workflows using container orchestration and infrastructure-as-code (IaC)

Implement observability, monitoring, and cost-management strategies for GPU and accelerator compute environments to maintain predictable performance and spend

Evaluate, integrate, and benchmark emerging hardware and software technologies across cloud and on-prem environments to improve scalability and throughput

Drive security, compliance, and operational runbooks for GenAI infrastructure including access controls, secrets management, and incident response procedures

Troubleshoot, profile, and optimize performance across GPU and CPU compute stacks to remove bottlenecks and increase reliability

Document architecture, operational practices, and mentor engineers to expand team capability and accelerate adoption of production-ready GenAI infrastructure

What’s required

Bachelor's or master's degree in computer science, electrical engineering, or a related technical field

3–7 years of experience building and maintaining scalable compute or machine learning infrastructure systems

Deep understanding of distributed systems, container orchestration (Kubernetes), and public cloud platforms such as AWS, Google Cloud Platform, or Azure

Hands-on experience with machine learning operations and infrastructure tools such as MLflow, Ray, Airflow, Kubeflow, and Terraform

Strong understanding of reinforcement learning concepts and their infrastructure implications

Proficiency in Python and systems-level programming in one or more languages such as Go, C++, or Rust

Strong debugging, performance profiling, and optimization skills across GPU and CPU compute stacks

Experience implementing monitoring, observability, and cost-optimization for GPU/accelerator-based compute environments

Excellent collaboration and communication skills with a systems-thinking mindset

Commitment to the highest ethical standards

We take care of our people

We invest in our people, their careers, their health, and their well-being. When you work here, we provide:

Fully-paid health care benefits

Generous parental and family leave policies

Mental and physical wellness programs

Volunteer opportunities

Non-profit matching gift program

Support for employee-led affinity groups representing women, minorities and the LGBT+ community

Tuition assistance

A 401(k) savings program with an employer match and more

ABOUT POINT72:

Point72 is a leading global alternative investment firm led by Steven A. Cohen. Building on more than 30 years of investing experience, Point72 seeks to deliver superior returns for its investors through fundamental and systematic investing strategies across asset classes and geographies. We aim to attract and retain the industry’s brightest talent by cultivating an investor-led culture and committing to our people’s long-term growth. For more information, visit https://point72.com/. 

The annual base salary range for this role is $180,000-$300,000 (USD) , which does not include discretionary bonus compensation or our comprehensive benefits package. Actual compensation offered to the successful candidate may vary from posted hiring range based upon geographic location, work experience, education, and/or skill level, among other things.

Source: Point72 careers (Greenhouse)

Similar roles

More roles at Point72