Tool Use Expert
@ Taskify

Hybrid
$93,600
Hybrid
Part Time
Posted 11 hours ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXXXX XXXXXXXXXXX XXXXXXX******* @taskify.com
Recommended after applying

Job Details

About the Role

The Tool Use Expert role at Taskify involves partnering with a leading AI research lab and engaging as an independent evaluation contractor. You will assess whether AI models appropriately invoke search tools and transform user prompts into effective queries, making a significant impact on improving AI performance.

Key Responsibilities

  • Review AI model interaction logs and assess tool invocation.
  • Evaluate rewritten search queries for clarity and intent.
  • Provide concise, evidence-based rationales and label edge cases.
  • Score query quality and calibrate against gold examples.
  • Track decisions in a task portal and flag sensitive content.

Qualifications / Skills Required

Excellent written communication, meticulous attention to detail, and ability to work independently in a remote, asynchronous environment. Familiarity with annotation tools or basic scripting (Python/SQL) is a plus, and multilingual proficiency is beneficial.

Work Details

  • Work Location: Fully Remote
  • Estimated Workload: 10–20 hours/week
  • Duration: Initial 6–10 weeks with potential extensions
  • Salary: $45 USD per hour (or equivalent per-task rates)

Key skills/competency

  • AI evaluation
  • Tool usage
  • Prompt engineering
  • Quality assurance
  • Attention to detail
  • Annotation tools
  • Data review
  • Independent work
  • Communication
  • Multilingual
Apply without a personalized resume

How to Get Hired at Taskify

🎯 Tips for Getting Hired

  • Research Taskify's culture: Read company mission and recent news online.
  • Customize your resume: Tailor skills to AI evaluation and tool usage.
  • Highlight remote experience: Emphasize asynchronous work prior achievements.
  • Prepare for technical queries: Brush up on annotation tools, Python, or SQL.

📝 Interview Preparation Advice

Technical Preparation

Review AI model logs.
Practice annotation tool usage.
Brush up on Python/SQL basics.
Study tool-to-query assessment methods.

Behavioral Questions

Describe remote work self-motivation.
Give an example of detail orientation.
Explain independent task management.
Discuss handling ambiguous information.

Frequently Asked Questions