Physician AI Trainer, $150/hour

Project Overview Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy. We are seeking a skilled Medical Doctor (MD or DO) to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis. Location: U.S.-based experts only Engagement: Part-time, project-based expert evaluation work Work Type: Remote Project Summary: CareerBench evaluates how effectively AI systems provide career guidance across professional occupations. We are seeking licensed Physicians to evaluate AI-generated career guidance related to medical education, residency training, fellowship pathways, specialty selection, clinical practice, academic medicine, healthcare leadership, and physician career advancement. Contributors will assess whether AI-generated recommendations accurately reflect medical training requirements, credentialing expectations, and professional realities within healthcare. This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors/employers (subject to those vendors’ allowances).

Responsibilities

Contributors will: Create benchmark answers for physician career-related questions Develop profession-specific evaluation rubrics Assess AI-generated guidance related to medical education, residency, and fellowship training Review recommendations concerning specialty selection and clinical career development Evaluate advice involving academic medicine, leadership, and alternative physician career paths Identify inaccurate, misleading, or non-compliant professional guidance Provide written rationale supporting scoring decisions and evaluations Expected Outcomes Accurate benchmark responses aligned with medical training and practice realities Reliable evaluation frameworks for physician career guidance Consistent scoring of AI-generated responses across medical career scenarios Identification of inaccuracies related to licensure, credentialing, and career progression High-quality expert feedback supporting trustworthy AI evaluation Qualifications Active U.S. MD or DO license required Minimum 3 years of post-training professional practice experience Experience in clinical medicine, academic medicine, or healthcare leadership Familiarity with residency, fellowship, and specialty training pathways Strong written communication and analytical skills Ability to evaluate professional guidance objectively and consistently U.S.-based LinkedIn Global Data Privacy Notice for Job Candidates Apply To This Job