English Voice AI Tester

Speech-to-Speech English Voice AI Tester

SME Careers is seeking a remote, hourly-paid contractor to test a speech-based AI model. You will engage in short, natural conversations with the AI, evaluate its performance, and provide feedback.

Key Responsibilities

• Conduct Speech-Based Scenario Conversations: Speak with the AI model in guided real-world use cases (e.g., shopping, customer support, making appointments), maintaining a natural conversation for ~5 minutes per session.
• Evaluate Model Performance: Answer follow-up questions assessing the model’s quality (e.g., accuracy, relevance, clarity, politeness, and ability to complete the task).
• Provide High-Quality Written Feedback: Write concise, specific notes on what worked well and what failed (e.g., misunderstandings, incorrect assumptions, awkward phrasing, conversation breakdowns).
• Follow Rubrics and Guidelines: Apply evaluation criteria consistently across sessions and adhere to task instructions.

Your Profile

• Must be currently living in the United States.
• Fluent in English (spoken, reading, and writing).
• Strong reading and writing skills with the ability to provide clear, detailed feedback.
• Comfortable speaking naturally and clearly on microphone for short sessions.
• Detail-oriented, consistent, and able to follow task instructions and evaluation rubrics.
• Reliable internet connection and access to a quiet environment for speaking tasks.

Key skills/competency

• Speech AI Testing
• Voice AI Evaluation
• Natural Language Processing
• Conversational AI
• Data Annotation
• AI Model Feedback
• Quality Assurance
• English Fluency
• Remote Work
• Customer Support Scenarios