Andromeda Shimu Deep Research Reviewer (EN-US)

Weloglobal
United States
RemoteCareer-pivot friendly

Who this role is best for

Aimed at mid-level to senior QA professionals with domain expertise in US consumer topics who can apply rubrics methodically.

Best fit for

  • Individuals with experience in editorial QA or content moderation and a strong grasp of US consumer topics
    — “Proven experience with rubric- or guideline based evaluation”
  • Candidates with a background in fact-checking or research who can assess claims and citations rigorously
    — “Check claims, tables, and citations for accuracy”
  • People who are detail-oriented and can maintain consistent judgment across multiple independent criteria
    — “Ability to judge each criterion independently, without letting an overall impression influence the call”

Things to consider

  • The role requires a stable internet connection and a dedicated computer for remote work
    — “Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer”
  • Freelance engagement may require managing multiple projects with a small team or independently
    — “Write clear, evidence-based rationales that help us improve the quality of AI research tools”

How to stand out

  • Emphasize experience in evaluating research content with rubrics and providing evidence-based feedback
    — “Evaluate each response against rubric criteria, scoring every criterion independently”
  • Highlight ability to distinguish primary sources from low-quality content in your resume or interview
    — “Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages”
  • Showcase your writing skills with concise, evidence-based rationales in your application materials
    — “Write short, specific rationales (1-3 sentences) that point to concrete evidence”
Pace · SteadyCollaboration · LowAutonomy · HighDecision Impact · Individual

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • evaluating AI-generated research
  • writing clear rationales
  • following guideline updates
Typical background
Bachelor's degree or equivalent experience in research, editing, fact-checking, teaching, or QA

Skills & requirements

Required

Long-form Research ReviewRubric-based EvaluationFact-checkingWriting Concise RationalesIndependent JudgmentUS Consumer Topics Knowledge

Preferred

Ai-generated Content Evaluation

Stack & domain

Ai-generated Research OutputsRubric- Or Guideline Based EvaluationAi/llm RatingSearch Quality RatingContent ModerationGradingEditorial QAUS Consumer TopicsPersonal Finance And TaxesHealthcare And InsuranceHome RepairPetsTravel PlanningEditorial EyeFact-checker's InstinctsDiscipline To Apply Guidelines ConsistentlyWriting Concise RationalesJudging Each Criterion IndependentlyResearchEditingFact-checkingTeachingQA

About the role

Original posting from Weloglobal via Lever

About the Role 

We're looking for a QA Deep Research Reviewer to evaluate long-form, AI-generated research outputs against detailed rubrics and guidelines. You'll read documents that include tables and citations, judge each criterion on its own merits, and write clear, evidence-based rationales that help us improve the quality of AI research tools. This role suits someone with a sharp editorial eye, a fact-checker's instincts, and the discipline to apply guidelines consistently

Project Details:

Location: Remote (United States)

Commitment: 15-20 hours per week

Engagement type: Freelancer

Pay rate: Philippines: $28 USD

What You'll Do

  • Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
  • Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
  • Write short, specific rationales (1-3 sentences) that point to concrete evidence
  • Follow guideline updates and calibrate your decisions consistently with the QA team.

Must-Have Qualifications

  • Native or near-native US English (C2), with the ability to read long documents containing tables and citations
  • Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
  • Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
  • Ability to write concise rationales that cite evidence
  • Ability to judge each criterion independently, without letting an overall impression influence the call
  • Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer.

Source: Weloglobal careers (Lever)

Similar roles

More roles at Weloglobal