Expert Prompt Curator

@ Taskify

About the Role

Taskify is partnering with a leading AI research lab to develop a next-generation evaluation dataset for frontier AI models. As an Expert Prompt Curator, you will design challenging prompts that require tool use (e.g., search, browsing, or code execution) to solve complex problems. This short-term research engagement offers the opportunity to shape AI evaluation benchmarks, contributing to safer and more capable AI systems.

Key Responsibilities

• Create original, expert-level prompts requiring tool use for problem-solving.
• Ensure prompts are objective, self-contained, and yield clear answers.
• Test prompts against advanced AI models and document outcomes.
• Provide detailed reasoning steps and solutions for each prompt.
• Classify prompts into subject domains for organized dataset creation.
• Collaborate with reviewers to validate and refine prompts.

Qualifications / Skills Required

• Advanced academic or professional expertise in a specialized subject (e.g., STEM, law, finance, history, cultural studies).
• Strong ability to design high-difficulty, precise questions with deep knowledge.
• Experience in academic research, benchmarking, or test question design is preferred.
• Meticulous attention to detail and ability to explain reasoning concisely.
• Familiarity with AI models and their limitations is a plus.

Work Location & Engagement Details

This is a fully remote position with flexible hours. Estimated commitment is 10–20 hours per week for a project duration of approximately 2 months, with potential extensions. Compensation ranges from $50 to $70 USD per hour based on expertise and subject matter specialization.

Key skills/competency

• Prompt Design
• AI Evaluation
• Research
• Dataset Creation
• Tool Use
• Problem Solving
• Detail Orientation
• Collaboration
• Classification
• Academic Expertise