Mercor review · AI Training & Data Labeling
General Physician — Health AI Model Evaluation (Mercor)
What the work involves
Mercor is hiring experienced medical practitioners (MDs and DOs) to evaluate health AI models in partnership with a leading AI lab. You'll assess model outputs across diagnosis, clinical reasoning and care workflows — scoring diagnoses, case reasoning and care recommendations against expert judgement, writing structured feedback on clarity, safety and clinical rigor, and flagging failure modes that compromise patient safety. It's a six-week part-time project (20+ hours per week) starting immediately, fully remote and asynchronous, with credential verification of your license, residency completion and current practice setting before roster placement.
What you'll do
- Evaluate AI model outputs for clinical accuracy, safety and alignment with medical standards
- Score diagnoses, case reasoning and care recommendations against expert judgement
- Write structured feedback on clarity, safety and clinical rigor
- Flag failure modes that compromise patient safety
- Collaborate asynchronously with AI researchers to improve model performance
Requirements & eligibility
- MD or DO from an accredited medical school
- Active, unrestricted US medical license
- Residency complete and currently practicing and seeing patients
- 3+ years of post-residency experience in your current role strongly preferred
- Practice in primary care, internal medicine or hospital-based specialties (Primary Care, General Internal Medicine, Family Medicine, Emergency Medicine, Critical Care)
- Sharp attention to detail, clear written communication, and based in the United States
How to apply
Applications go directly to Mercor. Read their terms before you sign up — and if anything feels off, run the scam check below first.
This is an affiliate link — PaidTaskers may earn a commission if you join, at no cost to you. It doesn't change what we list or how we rate the platform.
Apply on MercorNo published deadline. Spotted something wrong? Report it.
We reviewed this platform
Mercor: rates, payout terms & requirements
Read the review →