Turing review · AI Training & Data Labeling
AI Quality Analyst — Gemini Personalization (Turing)
What the work involves
Turing, the world's leading research accelerator for frontier AI labs, is staffing a global 24-hour operations team to evaluate a new personalization feature for Gemini. You'll assess how well the model uses information from your past Gemini conversations, Gmail, Google Search and YouTube activity to make responses more relevant and helpful — designing creative prompts from your own experiences, then judging the personalized answers on Grounding, Integration and Helpfulness.
The role blends creativity with analytical rigor. You write multi-turn starting prompts (typically 1–5 turns) built on your personal context, then stack-rank two model responses side-by-side and write clear, defensible rationales that reference specific turns. You'll also verify the model's Debug Info to confirm chat summaries and data sources were properly used, and keep strict data hygiene by deleting evaluation conversations afterwards.
| Engagement | Contractor, 3 months |
| Commitment | At least 4 hours/day, up to 40 hours/week |
| Overlap | 4 hours with PST |
| Location | Fully remote, global 24-hour team |
| Process | Job Interest Form → assessment within 24 hours → pre-onboarding |
What you'll do
- Design multi-turn conversational prompts (1–5 turns) that draw on your personal information and experiences
- Check whether personalization was appropriately applied to each response
- Flag Grounding issues — claims not supported by evidence, flawed inferences, hallucinations
- Assess Integration quality: personal data woven in naturally, without robotic overnarrating
- Stack-rank two responses side-by-side (SxS) and write rationales referencing specific turns
- Extract and verify Debug Info to confirm chat summaries and data sources were used
- Delete evaluation conversations to keep your future chat history clean
Requirements & eligibility
- Ability to read and write in English at a high level (English is the focus language)
- Willingness to use your primary personal Google account and enable personal data sources
- Full-time availability in your local time zone (global 24-hour operations team)
- Experience designing creative, multi-turn prompts based on personal context
- Understanding of personalization concepts — spotting incorrect personalization, poor inferences, forced connections
- Meticulous attention to detail for side-by-side response comparisons
- BS/BA or equivalent experience in Policy, Law, Ethics, Linguistics, Journalism, Computer Science or a related analytical field
- Data annotation, AI quality evaluation or content moderation experience strongly preferred
- Desktop/laptop with a good internet connection
How to apply
Applications go directly to Turing. Read their terms before you sign up — and if anything feels off, run the scam check below first.
This is an affiliate link — PaidTaskers may earn a commission if you join, at no cost to you. It doesn't change what we list or how we rate the platform.
ApplyNo published deadline. Spotted something wrong? Report it.
We reviewed this platform
Turing: rates, payout terms & requirements
Read the review →