Management Consultant (AI Evaluation)

Management Consultant (AI Evaluation) at Keystone Recruitment

Role Overview

One of Keystone Recruitment's clients is collaborating with a leading AI research lab, seeking experienced management consulting professionals for a project-based role. As a Management Consultant (AI Evaluation), you will translate real-world consulting workflows into structured tasks, datasets, and evaluation criteria. This is crucial for enhancing advanced AI systems' reasoning and problem-solving capabilities. This opportunity is ideal for professionals capable of independent work, structured thinking, and asynchronous collaboration in a deliverables-driven environment.

Key Responsibilities

• Break down complex consulting workflows, from problem structuring to analysis and synthesis, into clear task specifications and evaluation rubrics.
• Critically review, edit, and benchmark AI-generated outputs, including market analyses, strategic recommendations, operating models, and executive summaries.
• Develop high-quality reference examples such as issue trees, analytical models, and slide outlines, adhering to professional consulting standards.
• Identify and document logical gaps, unsupported assumptions, and weak reasoning in AI outputs, providing guidance for improvement.
• Engage in asynchronous collaboration with researchers and fellow contributors, utilizing structured documentation and written feedback mechanisms.

Ideal Qualifications

• Minimum of 2 years of experience within a top-tier management consulting firm or a reputable boutique consultancy.
• Demonstrated strong understanding of hypothesis-driven problem-solving and executive-level synthesis.
• Advanced proficiency in using PowerPoint and Excel for complex analysis and presentation.
• Proven experience in market sizing, financial/operating analysis, and qualitative research methodologies.
• Exceptional written communication and structured thinking abilities.
• Ability to effectively manage time and consistently meet deadlines within a remote work setting.

Role Details

• Expected commitment of 10+ hours per week.
• Deliverables-driven structure with clear quality standards.
• Flexible scheduling and a fully remote work arrangement.
• Ongoing support available for best practices and clarifications.

Application Process

To apply, submit a brief resume or LinkedIn profile detailing your consulting background and areas of expertise. Successful candidates will complete a short skills questionnaire, and a time-boxed exercise may be used for assessment. Selected individuals will be contacted with next steps and additional project details. Keystone Recruitment considers all qualified applicants without regard to legally protected characteristics, and reasonable accommodations are available upon request.

Contract and Payment Terms

This engagement is structured as an independent contractor role, offering fully remote work on a flexible schedule. The project scope may be adjusted based on needs and performance. It is critical that work does not involve access to confidential or proprietary information from any current or former employer, client, or institution. Weekly payments will be made via supported payment platforms based on services rendered.

Key skills/competency

• Management Consulting
• AI Evaluation
• Problem Structuring
• Market Analysis
• Strategic Recommendations
• Financial Analysis
• Hypothesis-Driven Problem Solving
• Structured Thinking
• Written Communication
• Excel & PowerPoint