All roles

Machine Learning Evaluation Specialist (Remote)

Remote · USA Full-time New today

This a Full Remote job, the offer is available from: United States, Turkey, Greece, Estonia, Latvia, North Macedonia, Hungary, Bulgaria, Albania, Poland, Romania, Kosovo, Portugal, Spain, Malta, United Kingdom, Austria, Belgium, Germany, Ireland, France, Slovakia, Czechia, Italy, Montenegro, Bosnia and Herzegovina, Paraguay, Uruguay, Brazil, Dominican Republic, Venezuela, Ecuador, Colombia, Argentina, Chile, Bolivia, Peru, Mexico, Puerto Rico, Canada, Serbia, Arizona (USA), California (USA), Colorado (USA), Delaware (USA), District of Columbia (USA), Florida (USA), Georgia (USA), Idaho (USA), Illinois (USA), Indiana (USA), Louisiana (USA), Nevada (USA), North Carolina (USA), Ohio (USA), Oklahoma (USA), Pennsylvania (USA), Tennessee (USA), Texas (USA), Virginia (USA), Washington (USA) Machine Learning Evaluation Specialist (Remote) List of accepted countries and locations Important for US applicants: This is a 1099 independent contractor role and is not compatible with F-1 OPT, STEM OPT, or other visa statuses that require W-2 employment, guaranteed hours, or employer sponsorship. We are unable to provide offer letters or employment verification for this role. Help design the hardest ML problems state-of-the-art AI hasn't solved yet. We're hiring domain experts to build evaluation tasks that challenge the frontier of AI. This is not an ML engineering role — it's a research role. You'll use deep expertise in your field to create problems that general ML knowledge can't touch. What you'll do

  • Propose and frame original, research-grade ML problems rooted in your domain
  • Design evaluation tasks that require specialized knowledge well beyond standard pipelines
  • Assess AI-generated solutions for correctness, creativity, and methodological rigor — and explain exactly where and why they fall short
  • Document problem difficulty, required domain knowledge, and expected failure modes

What you need

  • Graduate-level expertise (MS or PhD preferred) in a scientific or technical domain that intersects with ML
  • Strong working knowledge of ML methods — model selection, feature engineering, evaluation metrics
  • Deep familiarity with active research problems in your field — you know where general ML knowledge runs out
  • Excellent written communication — you can articulate complex problems clearly and precisely. This cannot be overstated.
  • Self-motivated and comfortable working independently on intellectually demanding tasks

What you don't need

  • No prior AI training or RLHF experience required
  • No software engineering background needed — domain expertise and research instincts are what matter

Domains we're especially looking for

  • Computational Biology / Bioinformatics
  • Genomics / Molecular Biology
  • Physics / Astrophysics / Signal Processing
  • Climate / Environmental Modeling
  • Healthcare / Medical Imaging
  • Neuroscience / Brain-Computer Interfaces
  • Materials Science / Chemistry
  • Finance / Quantitative Modeling
  • Robotics / Control Systems / Reinforcement Learning
  • Advanced NLP (specialized domains)
  • Mathematics / Statistics (applied)

Logistics

  • Fully remote — work from anywhere
  • $200–$400/hr depending on domain and seniority
  • 10–40 hrs/week, hourly contract
  • Assessment required — paid if approved
  • Independent contractor (1099) — not compatible with F-1 OPT, STEM OPT, or visa statuses requiring W-2 employment or employer sponsorship

⚠️ This is a project-based, freelance opportunity with no guaranteed hours. We recommend keeping other work options open while waiting for project assignment. This offer from "G2i Inc." has been enriched by Jobgether.com and got a 75% flex score. Apply tot his job Apply To this Job

Related roles

Technical Project Manager (AI & Data )

Remote · USA Full-time

Learning Projects

Remote · USA Full-time

Data Science Project Manager

Remote · USA Full-time

Senior Consultant/Manager, Business Development, Skift Exec Search

Remote · USA Full-time

Senior Consultant, R&D Tax Credits, Income Tax

Remote · USA Full-time

Sr. Risk Analyst – Market Risk

Remote · USA Full-time

Sr/ Manager/ Marketing Operations

Remote · USA Full-time

Sr. Manager, Content Supply Chain Technology

Remote · USA Full-time

Remote Medical Claims Analyst – Freshers Welcome

Remote · USA Full-time

Medicare Claims Processor (Remote To Wisconsin Only)

Remote · USA Full-time

Sr Software Engineer, Agentic AI

Remote · USA Full-time

US Tax Advisory Specialist (Remote within Luzon island, Cebu City, Davao City and Iloilo City)

Remote · USA Full-time

Experienced Online Chat Assistant – Customer Service Representative – Remote Work Opportunity at arenaflex

Remote · USA Full-time

Experienced Customer Care Representative – Empowering Customer Wellness through Remote Support at arenaflex

Remote · USA Full-time

Online Overnight Ticket Support Professional - Work from Any State

Remote · USA Full-time

Grant Director

Remote · USA Full-time

Associate II, Patient Safety Solutions, Remote based in Canada

Remote · USA Full-time

Experienced Senior Data Analyst for Remote Data Entry and Business Analysis at blithequark

Remote · USA Full-time

Immediate Hiring: Data Entry Remote Jobs at arenaflex $25/Hour – Work from Home

Remote · USA Full-time

Remote Customer Support Representative – arenaflex Data Entry & Service – No Experience Required – Part‑Time

Remote · USA Full-time