Data Scientist - AI Agent Intelligence

Data Scientist - AI Agent Intelligence

Mercor is seeking a Data Scientist to contribute to its AI lab partner, focusing on developing intelligent agent-based systems. This role is perfect for analytical individuals who can transform large datasets into actionable insights and thrive at the intersection of machine learning, experimentation, and real-world applications. You will be responsible for designing data pipelines, statistical models, and performance metrics to advance autonomous systems.

About You

• Strong background in data science, machine learning, or applied statistics.
• Proficiency in Python, SQL, and libraries like Pandas, NumPy, Scikit-learn, and PyTorch/TensorFlow.
• Understanding of probabilistic modeling, statistical inference, and experimentation frameworks (A/B testing, causal inference).
• Ability to collect, clean, and transform complex datasets for modeling and analysis.
• Experience designing and evaluating predictive models using metrics like precision, recall, F1-score, and ROC-AUC.
• Comfort working with large-scale data systems (Snowflake, BigQuery, or similar).
• Curiosity about AI agents and how data influences intelligent system behavior.
• Enjoy collaborating with cross-functional teams to define KPIs and experiment setups.

Primary Goal of This Role

Design and implement robust data models, pipelines, and metrics to support experimentation, benchmarking, and continuous learning for agentic AI systems. The focus is on building data-driven insights into agent reasoning, performance, and improvement across various tasks.

What You’ll Do

• Develop data collection and preprocessing pipelines for structured and unstructured data from agent simulations.
• Build and iterate on machine learning models for performance prediction, behavior clustering, and outcome optimization.
• Design and maintain dashboards and visualization tools for monitoring agent performance and trends.
• Conduct statistical analyses to evaluate AI system efficacy in different environments.
• Collaborate with engineers to design evaluation frameworks for reasoning quality, adaptability, and efficiency.
• Prototype data-driven tools and feedback loops to improve model accuracy and agent behavior.
• Translate experimental results into scalable, production-grade insights in close collaboration with AI research teams.

Why This Role Is Exciting

• Work at the forefront of AI agent intelligence, shaping their evolution through data.
• Integrate machine learning, experimentation, and data engineering within a single role.
• Collaborate with top-tier AI engineers on new agent benchmarks and feedback mechanisms.
• Contribute to a mission merging algorithmic reasoning, real-world performance, and human-like decision-making.

Pay & Work Structure

• Hourly contractor role with Mercor.
• Paid weekly via Stripe Connect, based on hours logged.
• Part-time (20-40 hours/week) with fully remote, async flexibility.
• Weekly bonus of $500 - $1000 USD per 5 tasks created.

Key skills/competency

• Data Science
• Machine Learning
• Python
• SQL
• Statistical Modeling
• Data Pipelines
• Agent-Based Systems
• AI Agents
• Experimentation
• Performance Metrics