Senior Machine Learning Engineer - AI Foundation

Xpengmotors
Santa Clara, CA
On-site

Who this role is best for

Aimed at experienced ML engineers with a focus on AI infrastructure and large-scale distributed systems, who have a background in autonomous driving or related domains and are comfortable with collaborative, high-impact technical work in Santa Clara, CA.

Best fit for

  • Candidates with a history of working on transformer-based models and advanced AI systems
    — “In-depth knowledge of transformer architecture and ways to accelerate the training and inference of transformer models”
  • Individuals with hands-on experience in distributed computing and high-performance training frameworks
    — “Experience of performing large scale distributed training of models”

Things to consider

  • The role demands a strong focus on infrastructure and system-level optimization for AI models
    — “Design and implement training data pipeline that streams data from hundreds of petabytes of labeled and unlabeled data”
  • The compensation range is high, but location-based pay adjustments may affect final offer
    — “The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations”

How to stand out

  • Highlight experience with PyTorch and model acceleration techniques in your resume and interviews
    — “Deep knowledge of PyTorch”
  • Emphasize your ability to profile and optimize models for speed and efficiency
    — “A track record of profiling model and doing detective work to improve model training and inference speed”
  • Showcase your work with large-scale distributed training and parallelism strategies like FSDP
    — “Accelerate training with state of the art parallelisms, e.g., FSDP, Expert Parallel, Context Parallel, and data types”
  • Demonstrate familiarity with cloud-based model inference and simulation systems
    — “Accelerate model inference on the cloud for closed-loop simulation”
  • Mention any prior work in the autonomous driving industry or related domains
    — “Previous experience in the autonomous driving industry”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · Company

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • Design and implement training data pipeline
  • Implement training framework for AI foundation models
  • Accelerate training and inference with parallelisms
  • Work on cutting-edge technologies
Typical background
Master's Degree in CS/CE/EE or equivalent industry experience

Skills & requirements

Required

Deep Knowledge Of PytorchExperience With Model Inference FrameworkIn-depth Knowledge Of Transformer ArchitectureExperience With Large Scale Distributed TrainingProficiency In Profiling Model And Improving Training/inference Speed

Preferred

Previous Experience In Autonomous Driving IndustryExperience With CUDA LanguageExperience With Edge Computing SystemsKnowledge Of Distributed Computing Frameworks

Stack & domain

PyTorchModel Inference FrameworkTransformer ArchitectureLarge Scale Distributed TrainingCUDAEdge Computing SystemsDistributed Computing FrameworksRayFSDPExpert ParallelContext ParallelData TypesTraining Data PipelineTraining FrameworkModel TrainingModel InferenceClosed-loop SimulationReinforcement LearningEnterprise Llm/vlm ApplicationsCollaborationProblem-solvingTeamworkAdaptabilityCommunicationAIMachine LearningAutonomous DrivingElectric VehiclesEvtol AircraftRobotics

About the role

Original posting from Xpengmotors via Greenhouse

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.

We are looking for a full-time Machine Learning Engineer - AI Foundation, with deep knowledge and strong enthusiasm towards establishing a state-of-art ML infrastructure for training very large foundation model and accelerating model training/inference.

Our mission is to solve the autonomous driving problem. You will work with a team of talented software engineers, machine learning engineers and research scientists to push the boundary of state-of-art machine learning models which will enable the next-generation E2E solution of autonomous driving.

Job Responsibilities:

Design and implement training data pipeline that streams data from hundreds of petabytes of labeled and unlabeled data from a fleet of over a million vehicles.

Implement training framework for all physical AI foundation models in XPeng, including VLA 2.0, XWorld, Robotics.

Accelerate training with state of the art parallelisms, e.g., FSDP, Expert Parallel, Context Parallel, and data types.

Accelerate model inference on the cloud for closed-loop simulation, reinforcement learning, and enterprise LLM/VLM applications.

Minimum Skill Requirements:

Master's Degree in CS/CE/EE, or equivalent, in industry experience.

Deep knowledge of PyTorch.

Knowledge of model inference framework (e.g. vLLM, SGLang)

In-depth knowledge of transformer architecture and ways to accelerate the training and inference of transformer models.

Experience of performing large scale distributed training of models.

A track record of profiling model and doing detective work to improve model training and inference speed.

Preferred Skill Requirements:

Previous experience in the autonomous driving industry.

Experience with CUDA language for writing custom ops.

Experience with edge computing systems.

Knowledge of disributed computing frameworks, such as Ray.

A track record of efficiently solving complex problems collaboratively on larger teams

What do we provide:

A fun, supportive and engaging environment.

Infrastructures and computational resources to support your work.

Opportunity to work on cutting edge technologies with the top talents in the field.

Opportunity to make a significant impact on the transportation revolution by the means of advancing autonomous driving.

Competitive compensation package.

Snacks, lunches, dinners, and fun activities.

The base salary range for this full-time position is $174,720-$295,680, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.

We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.

Source: Xpengmotors careers (Greenhouse)

Similar roles

More roles at Xpengmotors