1 day ago
AI Content Quality Analyst
The UVA VEC
Hybrid
Other
$78,000
Hybrid
Job Overview
Job TitleAI Content Quality Analyst
Job TypeOther
Offered Salary$78,000
LocationHybrid
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
AI Content Quality Analyst
We are seeking detail-oriented professionals with strong writing and analytical skills to support an innovative AI research initiative. In this role, you will help improve advanced language models by crafting high-quality prompts and developing ideal responses used to train and evaluate AI systems.
This is a flexible, short-term opportunity suited for individuals who enjoy simplifying complex ideas and contributing to meaningful technology development.
Key Responsibilities
- Create structured prompts designed to test AI reasoning and response quality
- Develop clear, high-quality reference answers (“gold standard” responses)
- Establish evaluation criteria and scoring rubrics
- Test AI outputs and assess performance against defined standards
- Support quality assurance efforts to maintain consistency across datasets
Minimum Qualifications
- Bachelor’s degree (completed or in progress)
- Strong writing, reasoning, and critical thinking skills
- Ability to work independently and meet deadlines
- Familiarity with AI tools such as ChatGPT or similar platforms
- Based in the United United States or Canada
Preferred Qualifications
- Background in teaching, research, or content evaluation
- Experience creating structured guidelines or instructional materials
Project Details
- Commitment: Minimum 20 hours per week
- Duration: Approximately 2 months
- Structured workflow with defined goals and evaluation tools
Application Process
- Complete a short AI-led interview (~15 minutes)
- Finish a 45-minute written assessment
- Selected candidates will be invited to join the project
Contract & Payment Terms
- Independent contractor role
- Fully remote with flexible scheduling
- Project scope may adjust based on performance and project needs
- No access to confidential external data required
- Weekly payments via Stripe or Wise
Key skills/competency
- AI Evaluation
- Prompt Engineering
- Content Development
- Language Models
- Critical Thinking
- Quality Assurance
- Data Annotation
- Technical Writing
- Scoring Rubrics
- Instructional Design
How to Get Hired at The UVA VEC
- Research The UVA VEC's mission: Study their goals, research initiatives, and contributions to AI and education.
- Tailor your resume: Highlight your writing, analytical, and critical thinking skills relevant to AI content evaluation.
- Showcase AI tool familiarity: Emphasize experience with ChatGPT or similar platforms in your application materials.
- Prepare for assessments: Practice structured writing and analytical reasoning for the AI-led interview and written assessment.
- Demonstrate independent work: Provide examples of meeting deadlines and managing tasks in flexible, remote environments.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What is the primary goal of the AI Content Quality Analyst role at The UVA VEC?
02What kind of AI tools should an applicant for the AI Content Quality Analyst position be familiar with?
03Is this AI Content Quality Analyst role a full-time position or a contract?
04What are the payment terms for the AI Content Quality Analyst contract at The UVA VEC?
05What is involved in the application process for the AI Content Quality Analyst position at The UVA VEC?
06Are there specific location requirements for the remote AI Content Quality Analyst role?
Explore similar opportunities that match your background