Machine Learning Evaluation Specialist

Machine Learning Evaluation Specialist (Remote)

G2i Inc. is seeking domain experts to build evaluation tasks that challenge the frontier of AI. This is a research role focused on creating problems that general ML knowledge cannot solve, requiring deep expertise in your specific field.

What You'll Do

• Propose and frame original, research-grade ML problems rooted in your domain.
• Design evaluation tasks that require specialized knowledge well beyond standard pipelines.
• Assess AI-generated solutions for correctness, creativity, and methodological rigor, explaining their shortcomings.
• Document problem difficulty, required domain knowledge, and expected failure modes.

What You Need

• Graduate-level expertise (MS or PhD preferred) in a scientific or technical domain that intersects with ML.
• Strong working knowledge of ML methods (model selection, feature engineering, evaluation metrics).
• Deep familiarity with active research problems in your field.
• Excellent written communication skills to articulate complex problems clearly and precisely.
• Self-motivated and comfortable working independently on intellectually demanding tasks.

What You Don't Need

• Prior AI training or RLHF experience.
• Software engineering background.

Domains We're Especially Looking For

• Computational Biology / Bioinformatics
• Genomics / Molecular Biology
• Physics / Astrophysics / Signal Processing
• Climate / Environmental Modeling
• Healthcare / Medical Imaging
• Neuroscience / Brain-Computer Interfaces
• Materials Science / Chemistry
• Finance / Quantitative Modeling
• Robotics / Control Systems / Reinforcement Learning
• Advanced NLP (specialized domains)
• Mathematics / Statistics (applied)

Logistics

• Fully remote — work from anywhere.
• $200–$400/hr depending on domain and seniority.
• 10–40 hrs/week, hourly contract.
• Assessment required — paid if approved.
• Independent contractor (1099) — not compatible with F-1 OPT, STEM OPT, or visa statuses requiring W-2 employment or employer sponsorship.

Important Note for US Applicants: This is a 1099 independent contractor role and is not compatible with F-1 OPT, STEM OPT, or other visa statuses that require W-2 employment, guaranteed hours, or employer sponsorship. We are unable to provide offer letters or employment verification for this role.

Disclaimer: This is a project-based, freelance opportunity with no guaranteed hours. We recommend keeping other work options open while waiting for project assignment.

Key skills/competency

• Machine Learning Evaluation
• Domain Expertise
• AI Research
• Problem Framing
• Evaluation Metrics
• Scientific Research
• Independent Work
• Written Communication
• ML Methods
• Problem Solving