Turing review · AI Training & Data Labeling

AI Quality Analyst (Personalization) — Thai (Turing)

AI quality evaluation
Pay
$15 per hour
Location
Remote · worldwide
Posted
Oct 18

What the work involves

Turing is staffing a global, 24-hour operations team to evaluate a new personalization feature for Gemini, and this posting is the Thai language track. You assess how well the model uses information from your past Gemini conversations, Gmail, Google Search and YouTube activity to make its answers more relevant and helpful. The work blends creativity with analytical rigor: you design multi-turn prompts (typically 1-5 turns) from your own personal context, then judge the personalized responses on Grounding, Integration and Helpfulness. You stack-rank two model responses side-by-side, write clear, defensible rationales that reference specific turn numbers, verify the model's Debug Info to confirm chat summaries and data sources were actually used, and keep strict data hygiene by deleting evaluation conversations afterwards.

It pays $15 per hour, runs about three months, and needs at least 4 hours a day with 4 hours of PST overlap. No prior AI experience is required — your Thai fluency and analytical judgment are what matter.

What you'll do

  • Design and execute multi-turn conversational prompts (1-5 turns) that draw on your personal information and experiences
  • Check whether personalization matches the purpose of each prompt
  • Flag inferred, unsupported or hallucinated statements about you
  • Assess Integration quality, checking personal data is woven in naturally without robotic over narrating
  • Stack-rank two model responses side-by-side and write defensible rationales referencing specific turn numbers
  • Use Debug Info to check the data used and delete finished evaluation conversations

Requirements & eligibility

  • High proficiency in reading and writing Thai (the focus language)
  • Readiness to use your real main Google account and enable personal data sources; no testing account
  • Full-time availability in your local time zone (global 24-hour operations team)
  • Careful analysis of model replies with ambiguous or subtle issues
  • Creative prompt engineering from personal context
  • Well-structured written rationales that reference individual turns
  • At least 4 hours/day, up to 40 hours/week, with 4 hours of PST overlap
  • BS/BA or equivalent experience in a relevant analytical field; annotation or AI evaluation experience preferred

How to apply

Applications go directly to Turing. Read their terms before you sign up — and if anything feels off, run the scam check below first.

This is an affiliate link — PaidTaskers may earn a commission if you join, at no cost to you. It doesn't change what we list or how we rate the platform.

Apply on Turing

No published deadline. Spotted something wrong? Report it.

We reviewed this platform

Turing: rates, payout terms & requirements

Read the review →