Research Scientist - Interactive Avatars

Synthesia
Europe +3 more
Remote

Who this role is best for

A natural match if you have experience with generative AI and diffusion models.

Best fit for

  • Candidates with a background in video diffusion models and a passion for building interactive AI systems.
    — “focus on avatar-centric, interactive video diffusion models”
  • Experts who have translated research into production-ready systems and are comfortable with multimodal AI.
    — “take research ideas through to working implementations, and motivation to see them reach production”
  • Individuals with a track record of publishing in top-tier ML and AI venues.
    — “publications at top-tier venues (e.g., CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, SIGGRAPH)”

Things to consider

  • The role demands a high level of technical ownership and rapid iteration.
    — “moves fast, iterates often, and turns breakthrough research into product capabilities that ship”
  • Candidates must be prepared to work with real-time and streaming generation systems.
    — “Experience with real-time or streaming generation, including autoregressive video diffusion”

How to stand out

  • Highlight end-to-end research projects involving dyadic interaction modeling in your resume.
    — “Contribute to the research direction for dyadic interaction modeling, and own well-scoped research problems end to end”
  • Emphasize your experience with multimodal model post-training and evaluation frameworks.
    — “Post-train multimodal models to generate rich, natural dyadic interactions from user audio and video inputs”
  • Showcase your ability to define data needs and collaborate with data teams.
    — “Partner with our data team to define data needs and shape high-quality datasets”
Pace · Fast PacedCollaboration · HighAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • advancing interactive avatar research
  • generating natural dyadic interactions
  • building robust evaluation frameworks
Typical background
machine learningdiffusion modelsmultimodal modeling

Skills & requirements

Required

Machine LearningDiffusion ModelsMultimodal ModelingResearch Implementation

Preferred

Real-time GenerationAudio-driven ModelingConversational Modeling

About the role

Original posting from Synthesia via Ashby

Synthesia is the world’s leading AI video platform for business, used by over 90% of the Fortune 100. Founded in 2017, the company is headquartered in London, with offices and teams across Europe and the US.

As AI continues to shape the way we live and work, Synthesia develops products to enhance visual communication and enterprise skill development, helping people work better and stay at the center of successful organizations.

Following our recent Series E funding round, where we raised $200 million, our valuation stands at $4 billion. Our total funding exceeds $530 million from premier investors including Accel, NVentures (Nvidia's VC arm), Kleiner Perkins, GV, and Evantic Capital, alongside the founders and operators of Stripe, Datadog, Miro, and Webflow.

ABOUT THE ROLE

As a Research Scientist, you will join a team of 40+ researchers and engineers in our R&D department, working on the frontier of generative AI with a focus on avatar-centric, interactive video diffusion models.

This is a unique opportunity for experts in machine learning and diffusion models to shape the future of AI video agents that listen, respond, and react like humans. As part of our Interactive Avatars team, you'll build models that hold natural, real-time conversations: understanding what a user says and how they say it, then responding with appropriate turn-taking, backchannels, gaze, and facial and body reactions. You'll join a team that moves fast, iterates often, and turns breakthrough research into product capabilities that ship.

WHAT YOU'LL DO

  • Contribute to the research direction for dyadic interaction modeling, and own well-scoped research problems end to end.
  • Advance the state of the art in the perceptual layer of interactive agents, including understanding user audio and video and generating contextually appropriate reactions.
  • Post-train multimodal models to generate rich, natural dyadic interactions from user audio and video inputs.
  • Adapt diffusion models to new conditioning signals, such as conversational state, turn-taking, and listener cues.
  • Build robust evaluation frameworks and test suites for continuous tracking of interaction quality.
  • Partner with our data team to define data needs and shape high-quality datasets.
  • Run rigorous experiments, and share findings that inform the team's technical decisions.

WHAT WE'RE LOOKING FOR

  • A strong ML background and hands-on experience with diffusion models, ideally for video or avatar generation.
  • Publications at top-tier venues (e.g., CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, SIGGRAPH) in areas such as world models, dyadic interaction, or video diffusion, or equivalent demonstrated impact.
  • Experience taking research ideas through to working implementations, and motivation to see them reach production.
  • Proficiency in PyTorch and modern ML tooling for large-scale training.
  • Clear communication of hypotheses, experiments, and results.

NICE TO HAVE

  • Experience with real-time or streaming generation, including autoregressive video diffusion.
  • Distillation or other techniques for low-latency inference.
  • Audio-driven facial, gesture, or full-body motion modeling.
  • Conversational modeling, such as turn-taking, backchanneling, or listener-response generation.
  • Experience mentoring students or junior researchers.

WHY JOIN US?

  • Build production-scale video foundation models in a fast-growing Generative AI company
  • Work on human-centric video generation with real-world impact
  • Tackle hard problems in scaling, stability, and controllability
  • Influence the direction of next-generation synthetic human technology
  • Join a highly technical, high-ownership environment where your work ships

If you want to work on cutting-edge generative video models and see your research power real-world products, we’d love to talk.

Our culture

At Synthesia we’re passionate about building, not talking, planning or politicising. We strive to hire the smartest, kindest and most unrelenting people and let them do their best work without distractions. Our work principles serve as our charter for how we make decisions, give feedback and structure our work to empower everyone to go as fast as possible. You can find out more about these principles here. https://www.notion.so/How-we-work-at-Synthesia-f794caa72f8446efb6be22b551ce0fa2?pvs=21

SERVING 50,000+ CUSTOMERS (AND 50% OF THE FORTUNE 500)

We’re trusted by leading brands such as Heineken, Zoom, Xerox, McDonald’s and more. Read stories from happy customers https://www.synthesia.io/case-studies and what 1,200+ people say on G2 https://www.g2.com/products/synthesia/reviews#reviews.

PROPRIETARY AI TECHNOLOGY

Since 2017, we’ve been pioneering advancements in Generative AI. Our AI technology is built in-house, by a team of world-class AI researchers and engineers. Learn more about our AI Research Lab and the team behind. https://www.synthesia.io/research

AI SAFETY, ETHICS AND SECURITY

AI safety, ethics, and security are fundamental to our mission. While the full scope of Artificial Intelligence's impact on our society is still unfolding, our position is clear: People first. Always. Learn more about our commitments to AI Ethics, Safety & Security https://www.synthesia.io/ethics.

Source: Synthesia careers (Ashby)

Similar roles