Staff Machine Learning Engineer, Personalization

Spotify
New York, NY
On-site

Who this role is best for

Candidates with production ML experience and a background in recommendation systems will find this senior role at Spotify offers a chance to shape global personalization systems.

Best fit for

  • Senior ML engineers with a track record in deploying large-scale recommendation systems
    — “you'll work at the intersection of recommendation systems, large language models, and production-scale machine learning infrastructure”
  • Individuals who have led technical direction in ambiguous problem spaces at scale
    — “drive technical direction in ambiguous problem spaces and contribute to the long-term architecture of personalization systems”
  • Candidates experienced in training and optimizing large language models for real-world applications
    — “train, fine-tune, evaluate, and optimize large language models using techniques such as supervised fine-tuning (SFT), distillation, and parameter-efficient training approaches”

Things to consider

  • The role demands alignment with the Eastern Standard time zone for team collaboration
    — “This team operates within the Eastern Standard time zone for collaboration”
  • Candidates must be prepared to mentor and influence technical decisions beyond their immediate team
    — “you communicate effectively across technical and non-technical audiences, and you influence technical decisions beyond your immediate team”

How to stand out

  • Highlight experience in taking models from research to production in high-volume environments
    — “someone who enjoys taking models from research to production”
  • Emphasize leadership in optimizing large language models for inference at scale
    — “experienced with large language model training, fine-tuning, evaluation, and optimization techniques”
  • Showcase skills in designing and executing A/B tests to improve user outcomes
    — “know how to design, execute, and interpret online experiments and A/B tests to improve user outcomes”
  • Demonstrate expertise in distributed ML frameworks like Ray, FSDP, or HSDP
    — “experience operating distributed machine learning workloads using technologies such as Ray, FSDP, HSDP, or similar frameworks”
  • Demonstrate experience in building and maintaining data pipelines with tools like Flyte or Airflow
    — “experience building and maintaining data pipelines and orchestration workflows using technologies such as Flyte, Airflow, BigQuery”
Pace · Fast PacedCollaboration · HighAutonomy · HighDecision Impact · CompanyLevel · Senior

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • build and ship personalized recommendations
  • train and fine-tune large language models
  • drive technical direction in ambiguous problem spaces
  • mentor other machine learning engineers
Typical background
8+ years experience building and deploying machine learning systemsdeep expertise in recommendation systems

Skills & requirements

Required

Machine Learning ModelsRecommendation SystemsLarge Language ModelsPyTorchSupervised Fine-tuningDistillationParameter-efficient TrainingA/B TestingModel EvaluationProduction Systems

Preferred

PersonalizationAgentic And Ai-powered User ExperiencesContent Recommendation SystemsLarge-scale Inference Systems

Stack & domain

Machine LearningRecommendation SystemsLarge Language ModelsProduction-scale Machine Learning InfrastructurePersonalizationContent Recommendation SystemsA/B TestingModel EvaluationSupervised Fine-tuningDistillationLoraCommunicationTeamworkProblem-solvingLeadershipMentorshipMusicPodcastsAI

About the role

Original posting from Spotify via Lever

The Personalization team makes deciding what to play next easier and more enjoyable for every listener. From Blend to Discover Weekly, we're behind some of Spotify's most-loved features. We built them by understanding the world of music and podcasts better than anyone else. Join us and you'll keep millions of users listening by making great recommendations to each and every one of them.

Surfaces Moments is a ML team within the Personalization Mission focused on creating moment-based experiences across Spotify surfaces. The team owns and evolves the experiences that help listeners quickly connect with the content that matters most to them, including the Home Shortcuts experience and the underlying intelligence that powers it. By combining cutting-edge machine learning, recommendation systems, and product thinking, the team delivers highly relevant, personalized experiences to millions of listeners around the world.

As a Staff Machine Learning Engineer, you will help shape the future of personalized discovery and engagement at Spotify. You'll work at the intersection of recommendation systems, large language models, and production-scale machine learning infrastructure to build experiences that delight users and drive meaningful impact. This role is ideal for someone who enjoys taking models from research to production, driving technical direction in ambiguous problem spaces, and solving complex personalization challenges at global scale.

What You'll Do:

Own and improve the machine learning models and systems that power the Home feed, including the Shortcuts experience.

Design, build, and ship personalized recommendations that serve millions of Spotify listeners globally.

Build content recommendation systems for emerging agentic and AI-powered user experiences.

Train, fine-tune, evaluate, and optimize large language models using techniques such as supervised fine-tuning (SFT), distillation, and parameter-efficient training approaches.

Partner closely with product managers, engineers, data scientists, and designers to define and execute experimentation strategies.

Drive A/B testing, monitoring, model evaluation, and continuous optimization of recommendation quality, reliability, and cost efficiency.

Improve ML platform capabilities, data pipelines, and production systems that support personalization at Spotify scale.

Drive technical direction in ambiguous problem spaces and contribute to the long-term architecture of personalization systems.

Mentor and support other machine learning engineers, helping raise the bar across the team.

Who You Are:

You have 8+ years of experience building and deploying machine learning systems in production environments.

You have deep expertise in recommendation systems, ranking models, personalization, or large-scale content discovery platforms.

You have strong proficiency in Python and hands-on experience building machine learning systems with PyTorch.

You are experienced with large language model training, fine-tuning, evaluation, and optimization techniques including SFT, distillation, and LoRA.

You have worked with large-scale inference systems and understand the challenges of latency, reliability, and cost optimization.

You care deeply about creating high-quality user experiences through thoughtful application of machine learning.

You communicate effectively across technical and non-technical audiences, and you influence technical decisions beyond your immediate team

You know how to design, execute, and interpret online experiments and A/B tests to improve user outcomes.

You have experience operating distributed machine learning workloads using technologies such as Ray, FSDP, HSDP, or similar frameworks.

You are experienced building and maintaining data pipelines and orchestration workflows using technologies such as Flyte, Airflow, BigQuery, and cloud-based storage platforms.

Where You'll Be:

We offer you the flexibility to work where you work best! For this role, you can be within the North Americas region as long as we have a work location.

This team operates within the Eastern Standard time zone for collaboration.

Spotify is an equal opportunity employer. You are welcome at Spotify for who you are, no matter where you come from, what you look like, or what’s playing in your headphones. Our platform is for everyone, and so is our workplace. The more voices we have represented and amplified in our business, the more we will all thrive, contribute, and be forward-thinking! So bring us your personal experience, your perspectives, and your background. It’s in our differences that we will find the power to keep revolutionizing the way the world listens.

At Spotify, we are passionate about inclusivity and making sure our entire recruitment process is accessible to everyone. We have ways to request reasonable accommodations during the interview process and help assist in what you need. If you need accommodations at any stage of the application or interview process, please let us know - we’re here to support you in any way we can.

Source: Spotify careers (Lever)

Similar roles