AI Safety & Responsibility Policy Manager

Runway Ml
United States
Remote

Who this role is best for

Content policy professionals with technical acumen in AI moderation will find this role balancing user safety and creative expression in a fast-evolving simulation domain.

Best fit for

  • Candidates with experience in content policy and AI moderation systems, especially those who can translate nuanced policy into functional documentation
    — “Excellent written communication skills, including ability to translate nuanced policy positions into clear, functional documentation”
  • Individuals who thrive in high-growth environments and can build policy infrastructure from scratch
    — “Experience in a high-growth startup environment where T&S/policy infrastructure was being built from scratch”
  • Professionals comfortable with data-driven policy decisions and auditing large volumes of content
    — “Strong ability to use data/statistics to inform policy decisions”

Things to consider

  • The role demands handling sensitive or disturbing content as part of routine policy enforcement
    — “Strong attention to detail and comfort reviewing large volumes of content, some of which may be sensitive or disturbing”
  • Policy ownership involves close coordination with engineering and product teams, requiring cross-functional collaboration
    — “Turn findings from audits and red teaming into clear, prioritized recommendations for policy, product and engineering partners”

How to stand out

  • Highlight experience in developing policies for generative AI products like video or image-based applications
    — “Familiarity with generative AI products, including video, image, or avatar-based applications”
  • Demonstrate your ability to maintain and update content policies in response to cultural or market shifts
    — “Track shifts in cultural and market norms and new use cases, and continuously evaluate and update policies accordingly”
  • Showcase your hands-on experience with machine learning systems for moderation or policy enforcement
    — “Hands-on experience using machine learning systems for content moderation, policy enforcement, or risk assessment”
  • Emphasize your ability to create and maintain golden datasets for AI moderation accuracy
    — “Create and maintain golden datasets that serve as the source of truth for moderation accuracy”
  • Demonstrate your capacity to lead red teaming efforts and maintain automated test banks
    — “Serve as policy owner in red teaming process, including maintaining automated test banks”
Pace · SteadyCollaboration · HighAutonomy · MediumDecision Impact · Team

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • creation and maintenance of content policies
  • continuous improvement of policy accuracy
  • effective communication with policy, product, and engineering partners
Typical background
experience in content policy or trust & safety policybackground in machine learning systems for content moderation

Skills & requirements

Required

Content PolicyTrust & Safety PolicyContent Moderation SystemsMachine Learning SystemsWritten Communication

Preferred

Llm-based Moderation

Stack & domain

Content PolicyTrust & Safety PolicyContent Moderation SystemsMachine Learning SystemsLlm-based ModerationWritten CommunicationAIPolicy Management

About the role

Original posting from Runway Ml via Ashby

We are building AI to simulate the world through merging art and science.

We believe that world models are at the frontier of progress in artificial intelligence. Language models alone won’t solve the world’s hardest problems – robotics, disease, scientific discovery. Real progress requires models that experience the world and learn from their mistakes, the same way that humans do. And this kind of trial and error can be massively accelerated when done in simulation, rather than in the real world.

World models offer the most clear path to general-purpose simulation, changing how stories are told, how scientific progress is made and how the next frontiers of humanity are reached.

Our team consists of creative, open minded, caring and ambitious people who are determined to change the world. We aspire to continuously build impossible things and our ability to do so relies on building an incredible team. If you are driven to do the same, we'd love to hear from you.

*Titles posted to our careers page are updated regularly to best advertise the role and expected seniority, but internally we have a flat titling system with two types of titles: one for individual contributors and one for people managers.

ABOUT THE ROLE

*Open to hiring remote across the US and Europe — we also have offices in NYC, San Francisco, Seattle, and London

As Runway’s products evolve and become increasingly capable, and as our user base expands, the need for clear and accurate content policies has never been greater. We're looking for a Policy Manager to own and evolve the policies that govern what our AI systems can and cannot do—across our consumer products, enterprise offerings, and third-party model integrations.

This role will own the creation, iteration, maintenance, and implementation of some of Runway’s content policies, working to capture genuine harms without unnecessarily blocking legitimate use cases. As we invest more heavily in LLM-based moderation, the quality of our policy will increasingly determine the quality of our moderation, and this role ensures that policy evolves along with the product and surrounding environment.

WHAT YOU’LL DO

  • Own and maintain some of Runway's content policies, balancing user safety, creative expression, and operational feasibility
  • Translate policies into LLM prompts and continuously iterate to drive accuracy improvements
  • Track shifts in cultural and market norms and new use cases, and continuously evaluate and update policies accordingly
  • Run ongoing accuracy audits to ensure we are finding and resolving key pain points quickly.
  • Serve as policy owner in red teaming process, including maintaining automated test banks.
  • Turn findings from audits and red teaming into clear, prioritized recommendations for policy, product and engineering partners.
  • Create and maintain golden datasets that serve as the source of truth for moderation accuracy, and keep them current as policies and products change.
  • As part of a small, collaborative AI Safety & Responsibility team, contribute to work across the broader team as priorities and needs evolve

WHAT YOU’LL NEED

  • Experience in content policy, trust & safety policy, or a closely related field
  • Strong understanding of content moderation systems
  • Hands-on experience using machine learning systems for content moderation, policy enforcement, or risk assessment
  • Excellent written communication skills, including ability to translate nuanced policy positions into clear, functional documentation
  • Strong attention to detail and comfort reviewing large volumes of content, some of which may be sensitive or disturbing
  • Strong ability to use data/statistics to inform policy decisions
  • Ability to act as a self-starter, taking initiative to identify opportunities to improve or build on processes and work products

NICE TO HAVE

  • Familiarity with generative AI products, including video, image, or avatar-based applications
  • Experience using LLMs for policy drafting and/or enforcement
  • Experience in a high-growth startup environment where T&S/policy infrastructure was being built from scratch

Runway strives to recruit and retain exceptional talent from diverse backgrounds while ensuring pay equity for our team. Our salary ranges are based on competitive market rates for our size, stage and industry, and salary is just one part of the overall compensation package we provide.

There are many factors that go into salary determinations, including relevant experience, skill level and qualifications assessed during the interview process, and maintaining internal equity with peers on the team. The range shared below is a general expectation for the function as posted, but we are also open to considering candidates who may be more or less experienced than outlined in the job description. In this case, we will communicate any updates in the expected salary range.

Lastly, the provided range is the expected salary for candidates in the U.S. Outside of those regions, there may be a change in the range, which again, will be communicated to candidates.

WORKING AT RUNWAY

Great things come from great teams. https://www.youtube.com/watch?v=kwmj4ato2kw&ab_channel=Runway We’d love to hear from you.

We’re committed to creating a space where our employees can bring their full selves to work and have equal opportunity to succeed. So regardless of race, gender identity or expression, sexual orientation, religion, origin, ability, age, veteran status, if joining this mission speaks to you, we encourage you to apply.

More about Runway

  • Universal World Simulator https://runwayml.com/world-simulator.html
  • GWM-1 https://runwayml.com/research/introducing-runway-gwm-1
  • Gen-4.5 https://runwayml.com/research/introducing-runway-gen-4.5
  • General World Models https://runwayml.com/research/introducing-general-world-models
  • Robotics SDK https://runwayml.com/research/introducing-runway-gwm-1#robotics-section
  • Conversational Real-time Agents https://runwayml.com/research/introducing-runway-gwm-1#avatars-section
  • Runway Studios https://runwayml.com/studios

We're excited to be recognized as a best place to work:

Crain's https://www.crainsnewyork.com/awards/best-places-work-2023 | InHerSight https://www.inhersight.com/companies/best/city/new-york-city-ny | BuiltIn NYC https://builtin.com/awards/new-york-city/2024/best-places-to-work | INC https://www.inc.com/best-workplaces/2024

Source: Runway Ml careers (Ashby)

Similar roles

More roles at Runway Ml