MSR Project - Japanese Culture Expert

Weloglobal
Japan
RemoteCareer-pivot friendly

Who this role is best for

Best suited to detail-oriented researchers with Japanese cultural expertise working in AI language evaluation.

Best fit for

  • Individuals who can identify region-specific issues in AI responses and document them systematically
    — “Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures.”
  • Those with strong analytical and writing skills to create evaluation rubrics and test queries
    — “Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning”

Things to consider

  • The role requires a high level of academic qualification and may not be accessible to those without a PhD
    — “This position currently accepts PhD applications only.”
  • Candidates must be prepared to test multiple queries before identifying specific AI failures
    — “Testing multiple queries before finding failures is expected.”
  • The role demands consistent time investment, with a 20-hour weekly commitment for an ongoing project
    — “Commitment: 20/hours week.”

How to stand out

  • Demonstrate your ability to create and document evaluation criteria for AI responses
    — “Write instructions and evaluation criteria for correct answers.”
  • Showcase your background in research or quality assurance with a focus on precision and source verification
    — “Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification”
  • Emphasize your iterative problem-solving approach and comfort with trial-and-error
    — “Problem-solving mindset — Comfortable iterating and testing when things don't work”
  • Demonstrate your ability to identify contradictions and outdated information in sources
    — “Critical thinking — Can spot contradictions between sources, identify outdated information”
Pace · SteadyCollaboration · LowAutonomy · HighDecision Impact · Individual

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

  • accurate identification of AI model failures
  • clear documentation of evaluation criteria
Typical background
PhD in relevant fieldresearch experience

Skills & requirements

Required

Research SkillsCritical ThinkingAttention To DetailProblem-solvingWriting Clarity

Preferred

Quality AssuranceComplianceLocale Knowledge

Stack & domain

Research SkillsAbility To Find And Verify Information From Multiple SourcesComfort Navigating Different Websites, Databases, And DocumentationCritical ThinkingSpot Contradictions Between SourcesIdentify Outdated InformationRecognize When Something Doesn't Apply To A Specific Locale/contextAttention To DetailCatch Nuances In LanguageLocal Variations (prices, Regulations, Requirements)Edge CasesProblem-solving MindsetComfortable Iterating And TestingWriting ClarityArticulate Instructions And Rubrics ClearlyLocale KnowledgeDeep Familiarity With Their Specific Locale (local Regulations, Business Practices, Cultural Nuances)Strong Written And Verbal CommunicationLanguagesWritingQuality EvaluationAI Model EvaluationSearch-related FailuresLocal RelevanceSource QualityOutdated InformationLanguage MismatchesIncomplete AnswersRegion-specific Inapplicability

About the role

Original posting from Weloglobal via Lever

Overview 

Are you passionate about languages, writing, and quality evaluation? We are launching an exciting language evaluation project and are looking for Japanese-speaking experts to join our team. 

What you will do:  

Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries, test them, document what went wrong, and write instructions and evaluation criteria for correct answers.

Common issues: local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability. Testing multiple queries before finding failures is expected.

Project Details: 

  • Start Date: ASAP
  • Duration: Ongoing Project.
  • Commitment: 20/hours week.
  • Job Type: Freelance contract.
  • Location: Japan, Remote
  • Rate: $68.25 per hour.
  • This position currently accepts PhD applications only.

Requirements:  

  • Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
  • Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
  • Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
  • Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
  • Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
  • Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
  • Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures

Source: Weloglobal careers (Lever)

Similar roles