Job Description
We are hiring a senior clinical medicine domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models reason about real clinical work.
Your clinical expertise is the substance of this role. You will review the quality of medical knowledge work tasks, write the instruction specs and golden solutions that define what "correct" looks like, and build the benchmarks that show whether the model is genuinely improving. We are looking for a practicing clinician rather than a generalist.
This is a full-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce. You will be provisioned with client-issued accounts and equipment, and will work inside the client's own tools alongside their research teams.
Location: This is a hybrid role based in the Bay Area, California. You must live in the Bay Area and work on-site with the client's team multiple days each week, when required. This is not a remote role. If you do not currently live in the Bay Area, you must be willing to relocate there at your own cost before the engagement starts. Relocation assistance is not provided.
Key Responsibilities
- Data QA and reviews: Vet the quality of clinical knowledge work tasks and model outputs, spotting missing behaviors, thin reasoning, unsafe or off-guideline recommendations, and answers that read well but would not survive clinical scrutiny.
- Instruction specs and golden datasets: Write high-quality instruction specs, produce golden solutions to clinical problems, and define new clinical tasks that reflect how medicine is actually practiced.
- Benchmarks and domain depth: Design challenging clinical tasks and evaluation sets, and help build medicine-specific skills and tools together with the research team.
- Calibration: Work with client researchers and specialists in adjacent fields to keep standards consistent, translating tacit clinical judgment into explicit, teachable criteria.
Core Qualifications
- Education: MD or DO from an accredited medical school, with a completed residency in a recognized specialty.
- Experience: 4+ years of post-residency clinical practice. Residency and fellowship training alone do not count toward the four years.
- Licensure: Active, unrestricted license to practice medicine in at least one U.S. state, and board certification in your specialty.
- Domain depth: Genuine specialization in a defined clinical specialty, for example internal medicine, oncology, radiology, emergency medicine, surgery, psychiatry, or a medical subspecialty. Experience in utilization management, clinical informatics, or medical affairs is a plus.
- Seniority: Clear progression to a senior level, for example Attending Physician, Medical Director, Division Chief, Associate or full Professor, or Chief Medical Officer, with real ownership of clinical decisions.
- AI fluency: Hands-on working use of large language models in your professional work, and the judgment to tell a well-reasoned answer from a plausible-sounding wrong one.
- Availability: Able to commit reliably to 40 hours per week for an initial engagement of 6 months.
- Location: Living in the Bay Area, California, and able to work on-site with the client's team multiple days each week, when required. Candidates not currently based in the Bay Area must be willing to relocate there at their own cost. Relocation assistance is not provided.
- Excellent written communication, and the ability to give precise, well-structured written feedback.
About Cincinnatus LLC
Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.
Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve part-time or full-time commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows.
Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus LLC.
Equal Employment Opportunity
Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.
Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
