Turing review · AI Training & Data Labeling
AI Quality Analyst (Personalization) — Korean (Turing)
What the work involves
Turing is staffing a global, 24-hour operations team to evaluate a new personalization feature for Gemini, and this posting is the Korean language track. You assess how well the model uses information from your past Gemini conversations, Gmail, Google Search and YouTube activity to make its answers more relevant and helpful. The work blends creativity with analytical rigor: you design multi-turn prompts (typically 1-5 turns) from your own personal context, then judge the personalized responses on Grounding, Integration and Helpfulness. You stack-rank two model responses side-by-side, write clear, defensible rationales that reference specific turn numbers, verify the model's Debug Info to confirm chat summaries and data sources were actually used, and keep strict data hygiene by deleting evaluation conversations afterwards.
It pays $15 per hour, runs about three months, and needs at least 4 hours a day with 4 hours of PST overlap. No prior AI experience is required — your Korean fluency and analytical judgment are what matter.
What you'll do
- Design and execute multi-turn conversational prompts (1-5 turns) that draw on your personal information and experiences
- Determine whether personal information was used appropriately for the request
- Analyze responses for Grounding issues — claims about you that are unsupported, inferred or hallucinated
- Assess Integration for natural wording and review the answer's Helpfulness
- Inspect Debug Info to verify source use, then clear the evaluation chats
- Choose the better of two responses and explain the ranking using specific turns
Requirements & eligibility
- High proficiency in reading and writing Korean (the focus language)
- A primary personal Google account with required data sources enabled, not an account made for testing
- Full-time availability in your local time zone (global 24-hour operations team)
- Good analytical thinking when responses involve nuance or uncertainty
- Creative prompt engineering from personal context
- Strong written communication, including rationales tied to specific turns
- At least 4 hours/day, up to 40 hours/week, with 4 hours of PST overlap
- A BS/BA or equivalent analytical experience; annotation or AI evaluation experience is preferred
How to apply
Applications go directly to Turing. Read their terms before you sign up — and if anything feels off, run the scam check below first.
This is an affiliate link — PaidTaskers may earn a commission if you join, at no cost to you. It doesn't change what we list or how we rate the platform.
Apply on TuringNo published deadline. Spotted something wrong? Report it.
We reviewed this platform
Turing: rates, payout terms & requirements
Read the review →