Member of Technical Staff (Product Data Scientist, Search Quality)

Perplexity
Belgrade, RS
RemoteCareer-pivot friendly

Who this role is best for

Best suited to mid-level data scientists with search product experience who can deliver production-grade Python code in a remote setting.

Best fit for

  • Search product veterans who can translate user behavior into ranking improvements
    — “working on search-related products, with emphasis on designing online metrics
  • Data pipeline builders comfortable blending human and LLM feedback systems
    — “construct data labeling pipelines with human and LLM feedback
  • Statistically rigorous experimenters who own metrics from hypothesis to dashboard
    — “Formulate hypotheses and validate them by designing, running, and analyzing A/B tests

Things to consider

  • Production coding expectations exceed typical data science roles
    — “expected to write production-grade code
  • Search quality focus requires comfort with ranking algorithms
    — “help to deliver better ranking quality

How to stand out

  • Showcase Spark or Databricks implementations in past search projects
    — “Proficiency with Apache Spark
  • Document cases where you operationalized LLM-as-judge systems
    — “development of LLM-as-a-judge systems
  • Highlight dashboard builds that drove product roadmap decisions
    — “implement them in dashboards
Pace · Fast PacedCollaboration · MediumAutonomy · MediumDecision Impact · TeamLevel · Mid

Derived from job-description analysis by Serendipath's career intelligence engine.

Skills & requirements

Required

Data AnalysisA/B TestingPythonSQLBusiness Intelligence ToolsStatistics

Preferred

Apache SparkDatabricksLlm-as-a-judge Systems

Stack & domain

PythonSQLApache SparkDatabricksLlm-as-a-judge Systems

About the role

This role involves a dynamic blend of data analysis and product development, where a skilled data scientist will work closely with user behavior data to enhance search technology, making it a perfect fit for someone who thrives in a fast-paced, innovation-driven environment.

Original posting from Perplexity via Ashby

Perplexity is looking for an experienced Product Data Scientist to accelerate the development of advanced search technologies. You will identify robust and sensitive signals from user behavior to help us gather insights from A/B experiment data more efficiently.

Responsibilities

  • Develop data-driven insights from user behavior to inform our product roadmap and accelerate adoption
  • Formulate hypotheses and validate them by designing, running, and analyzing A/B tests
  • Determine appropriate metrics and visualizations for tracking, and implement them in dashboards
  • Design new pipelines that will help to deliver better ranking quality. From discovering new signals, producing metrics and construct data labeling pipelines with human and LLM feedback

Qualifications

  • 4+ years of experience working as a data analyst or in a related role
  • Experience working on search-related products, with emphasis on designing online metrics and analyzing A/B experiments
  • Strong Python skills (expected to write production-grade code)
  • Proficiency with SQL
  • Experience with Business Intelligence (BI) tools
  • Deep knowledge of statistics

Preferred Qualifications

  • Proficiency with Apache Spark
  • Experience with Databricks
  • Experience with development of LLM-as-a-judge systems

Source: Perplexity careers (Ashby)

Similar roles