3 hours ago
AI Quality Analyst
Crossing Hurdles
Hybrid
Contractor
$20,020
Hybrid
Job Overview
Job TitleAI Quality Analyst
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$20,020
LocationHybrid
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Position: AI Quality Analyst (Personalization) - English
This is a short-term contract position for an AI Quality Analyst focusing on personalization. You will work remotely, committing 30-40 hours per week for approximately 2 months, with an immediate start date.
Role Responsibilities
- Design multi-turn conversational prompts based on personal context.
- Evaluate personalized AI responses for relevance, grounding, and helpfulness.
- Assess correct and incorrect use of personal data in model outputs.
- Perform side-by-side (SxS) evaluation and ranking of AI responses.
- Identify grounding errors, poor inferences, and forced personalization.
- Write clear, structured rationales referencing specific conversation turns.
- Extract and verify model debug information and data source usage.
- Maintain strict data hygiene by deleting evaluation conversations.
Requirements
- English fluency (reading and writing).
- Strong experience in data annotation, AI quality evaluation, content moderation, or related roles.
- Strong analytical thinking and attention to detail.
- Ability to evaluate nuanced and ambiguous AI responses.
- Comfortable using a primary personal Google account with enabled data sources.
- BS/BA degree or equivalent experience in a relevant analytical field.
- Strong written communication and structured feedback skills.
- Self-motivated and able to work independently in a remote setting.
- Reliable desktop/laptop with stable internet connection.
Application Process
To apply for the AI Quality Analyst position at Crossing Hurdles, please complete the following steps:
- Fill out the application form.
- Complete the ICF Assessment.
Key skills/competency
- Data Annotation
- AI Quality Evaluation
- Content Moderation
- Analytical Thinking
- Attention to Detail
- Personalization Assessment
- Conversational AI
- Feedback Generation
- Google Account Management
- Data Hygiene
How to Get Hired at Crossing Hurdles
- Research Crossing Hurdles' culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Customize your resume to highlight data annotation, AI quality, and analytical skills relevant to the AI Quality Analyst role.
- Showcase analytical prowess: Prepare to discuss examples demonstrating your attention to detail and ability to evaluate nuanced information.
- Master the assessment: Practice for the ICF Assessment, understanding it's a critical step in the Crossing Hurdles application process.
- Highlight remote work experience: Emphasize your ability to work independently and communicate effectively in a remote setting.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What is the primary focus of the AI Quality Analyst role at Crossing Hurdles?
02What kind of experience is Crossing Hurdles looking for in an AI Quality Analyst candidate?
03How long is the contract for the AI Quality Analyst position with Crossing Hurdles?
04Is the AI Quality Analyst position at Crossing Hurdles fully remote?
05What are the weekly hour commitments for the AI Quality Analyst role at Crossing Hurdles?
06What is the application process like for the AI Quality Analyst role at Crossing Hurdles?
Explore similar opportunities that match your background