Japanese Linguistic Evaluator & Functional Tester

Weloglobal

Tokyo, Japan

On-site

Who this role is best for

Best suited to native-level Japanese speakers with attention to detail working in AI and consumer technology.

Best fit for

Native-level Japanese speakers who enjoy identifying subtle language nuances in AI output
— “evaluating a pre-release AI model in your language”
Candidates with experience in fact-checking and quality assessment of multilingual content
— “Review pre-release AI model output in Japanese and judge it on accuracy, naturalness, appropriateness, and overall quality”
Individuals comfortable with on-site work and testing AI models on real devices
— “hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how the product actually performs on a client-supplied device”

Things to consider

The position involves evaluating AI models before public release, which demands high precision and responsibility
— “your judgement shapes how well it works before anyone else uses it”

How to stand out

Emphasize prior experience in evaluating AI-generated text for cultural and linguistic accuracy
— “judge it on accuracy, naturalness, appropriateness, and overall quality”
Highlight any background in testing software or hardware products on real devices
— “testing how the product actually performs on a client-supplied device”

Pace · SteadyCollaboration · LowAutonomy · MediumDecision Impact · Individual

Derived from job-description analysis by Serendipath's career intelligence engine.

What success looks like

evaluate AI model output
test product performance
ensure compliance

Typical background

language expertisequality assurance

Skills & requirements

Required

Linguistic EvaluationFunctional TestingAI Model Evaluation

Preferred

Product TestingQuality Assurance

Stack & domain

Japanese LanguageAI EvaluationFunctional TestingTechnologyLocalization

About the role

Original posting from Weloglobal via Lever

About Welocalize
Welocalize, a Welo Global brand, serves localization teams through AI-enabled multilingual content solutions that enable enterprises to operate and scale globally. Welocalize combines AI, automation, and human expertise to support enterprises in more than 300 languages, enabling accurate, culturally aligned, and compliant multilingual content at scale.
Welocalize’s Opal Platform comprises patented technology designed to automate multilingual content and improve workflow performance for enterprises. Opal functions as an agentic system that orchestrates AI, automation, and human expertise to coordinate content workflows across the lifecycle, improving speed, scalability, and operational control for global enterprises. These solutions operate within a secure and compliant environment supported by seven ISO certifications. Welocalize is headquartered in New York with offices worldwide. welocalize.com
ROLE OVERVIEW
Welocalize is looking for a native-level Japanese speaker to join a confidential, large-scale AI and consumer technology programme for a major global technology and communications client.
It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how the product actually performs on a client-supplied device — a smartphone and a next-generation smart glass. If you enjoy noticing the detail other people miss, this is work you'll find satisfying.
Welocalize is looking for a native-level Japanese speaker to join a large-scale AI and consumer technology programme.
It's a hands-on, on-site role that combines two things: evaluating a pre-release AI model in your language, and testing how it performs on a real device. You'll be among the first people to see this technology in Japanese, and your judgement shapes how well it works before anyone else uses it.
If you enjoy noticing the detail other people miss, this is work you'll find satisfying.
MAIN RESPONSIBILITIES
Review pre-release AI model output in Japanese and judge it on accuracy, naturalness, appropriateness, and overall quality — would a native speaker really say it this way? This includes fact-checking each response against the source material.

Source: Weloglobal careers (Lever)