Data Science Expert – AI Evaluation Project
The UVA VEC · United States
- On site
- Other
- United States
Tailored resume — keyword-matched to this role.
Hiring manager — we find who's hiring.
Intro email — drafted to reach them directly.
About the role
Data Science Expert – AI Evaluation & Analytics Assessment Project (Remote)
Contract Type: Independent Contractor
Location: Remote
Compensation: $120–$170 per hour
We are seeking experienced Data Science Professionals to support an advanced AI research initiative focused on evaluating how effectively AI systems perform real-world data science work.
Rather than building analytics deliverables yourself, you will leverage your expertise to define evaluation standards, assess AI-generated work, and provide structured feedback that helps improve the analytical reasoning capabilities of next-generation AI models.
This opportunity is ideal for experienced data scientists with strong backgrounds in experimentation, statistical analysis, machine learning, and business analytics.
- Design detailed evaluation criteria for real-world data science deliverables, including:
- Data analysis reports
- Predictive models
- Dashboards and visualizations
- Experiment results and A/B testing analyses
- Business recommendations and technical documentation
- Evaluate AI-generated and human-produced work using structured scoring frameworks
- Provide detailed written justifications for evaluation decisions
- Apply consistent, evidence-based judgment to ensure reliable and reproducible assessments
- Review analytical approaches, statistical methodologies, and business insights for quality and accuracy
- Incorporate reviewer feedback and continuously refine evaluation standards
- Collaborate with project teams to improve AI performance in data science tasks
- 5+ years of professional experience in Data Science or Analytics
- Experience in product, business operations, growth analytics, or related functions at leading technology companies
- Strong expertise in:
- SQL and Python
- Experiment design and A/B testing
- Statistical analysis and hypothesis testing
- Metric definition and KPI development
- Data visualization and dashboard design
- Ability to communicate technical findings effectively to business and executive stakeholders
- Excellent analytical thinking and written communication skills
- High attention to detail and consistency in evaluation
- Experience evaluating technical work or mentoring data science teams
- Familiarity with AI model evaluation, reinforcement learning, or human-feedback projects
- Experience working with large-scale datasets and business intelligence tools
- Knowledge of machine learning workflows and model performance evaluation
- Passion for advancing AI through expert human feedback
- Fully remote engagement
- Flexible working schedule
- Project-based work with opportunities for ongoing participation
- Collaborate with AI researchers and experienced data professionals
- Contribute to the development of next-generation AI systems for data science applications
- Help shape the future of AI-powered analytics and decision-making
- Apply your data science expertise to innovative AI research
- Flexible remote work environment
- Competitive hourly compensation
- Work alongside leading experts in AI, analytics, and technology
- Independent contractor engagement
- Fully remote work arrangement
- Flexible scheduling
- Weekly payments via Stripe or Wise
- Project duration may vary based on project needs and performance
- No access to confidential third-party information required
- Visa sponsorship is not available for this role