ML Challenge Task Auditor (Remote, Contract, $70–$90/hr) — Mercor via AI Gig Scout

Mercor is hiring ML Challenge Task Auditors as independent contractors at $70–$90/hr to evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You will assess experiment design, model-selection reasoning, hyperparameter choices, evaluation methodology and data-quality rigor (leakage, metric gaming, train/test/CV hygiene).

Requirements: 3+ years hands-on applied/experimental ML; strong grasp of data-quality rigor; proficiency with PyTorch, TensorFlow, scikit-learn or XGBoost; ability to critique ML claims against evidence and reproduce results. Preferred: Kaggle or similar competition/benchmark experience; graduate research or publication record in applied ML; prior task-grading or peer-review experience. Note: this role evaluates applied/experimental ML rigor — it is not an LLM-application-building or MLOps role.

Details and apply link: https://aigigscout.com/jobs/mercor/ml-challenge-task-auditor-list-aaaboepzleigumznqxnfkjzb?utm_source=kubernetesjobs&utm_medium=jobboard&utm_campaign=aigigscout_growth

Disclosure: posted by AI Gig Scout, an independent listing site (not Mercor). The apply link may be a referral link.