
AI Chatbot Tester
MCI · United States
- Hybrid
- Full-time
- $75,000 / year
- United States
Tailored resume — keyword-matched to this role.
Hiring manager — we find who's hiring.
Intro email — drafted to reach them directly.
Job highlights
- Test and validate AI chatbot functionality and responses.
- Ensure chatbot accuracy, reliability, and compliance.
- Analyze conversations and recommend improvements.
- Collaborate with AI trainers and prompt engineers.
- Contribute to chatbot optimization and best practices.
About the role
About MCI
MCI is a rapidly growing tech-enabled business services company with a significant call center presence and international operations. We offer Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across diverse industries like healthcare, retail, government, education, telecom, technology, e-commerce, and financial services. Our contact centers utilize both on-site and remote agents, employing advanced technologies to enhance customer interactions, ensure scalability, and manage costs.At MCI, we are dedicated to creating an environment where professionals can develop fulfilling careers, access ongoing learning and development, and contribute to a leading global organization.
Job Summary
We are looking for an AI Chatbot Tester to evaluate, validate, and enhance AI-powered chatbot and conversational AI solutions. This role is crucial for ensuring that chatbot responses are accurate, reliable, compliant, and meet business requirements and user expectations. The successful candidate will be instrumental in upholding quality standards and improving customer experiences in AI-driven communications.Key Responsibilities
Chatbot Testing & Validation
- Execute test plans and chatbot evaluation scenarios.
- Assess response quality and conversational effectiveness.
- Validate chatbot functionality across various use cases.
- Identify defects, inconsistencies, and performance issues.
Quality Assurance
- Conduct regression and user acceptance testing.
- Verify compliance with business requirements.
- Document test results and findings.
- Support issue resolution activities.
Conversation Analysis
- Review chatbot interactions and user journeys.
- Identify gaps in conversational flows.
- Recommend improvements to responses and workflows.
- Analyze trends and recurring issues.
Collaboration & Reporting
- Work closely with AI trainers and prompt engineers.
- Provide testing feedback to development teams.
- Participate in quality review sessions.
- Prepare reports and performance insights.
Continuous Improvement
- Support chatbot optimization initiatives.
- Contribute to testing standards and best practices.
- Stay informed about conversational AI developments.
- Assist with evaluation framework improvements.
Candidate Profile
We encourage all positive and driven applicants to apply. Ideal candidates are highly motivated, dedicated, and possess the following qualities:- Diploma or Bachelor's Degree in Information Technology, Quality Assurance, Communications, Business, or a related field.
- Experience in software testing, QA, customer experience, or chatbot evaluation.
- Strong attention to detail.
- Excellent written communication skills.
- Analytical and problem-solving abilities.
- Experience documenting defects and test outcomes.
- Ability to follow testing methodologies and processes.
- Strong organizational skills.
- Ability to work independently and collaboratively.
- Basic understanding of AI and chatbot technologies.
- Experience using productivity and reporting tools.
- Customer-focused mindset.
Nice to Have
- Experience testing AI chatbots or virtual assistants.
- Knowledge of prompt engineering principles.
- Familiarity with Generative AI technologies.
- Experience with QA management tools.
- Exposure to conversational design principles.
- Knowledge of user experience testing methodologies.
- Experience within technology or BPO environments.
- Understanding of AI evaluation metrics.
Work Environment
This position operates in a professional office setting. The role involves prolonged periods of sitting and/or standing while using a computer and telephone headset. Employees will regularly operate office equipment such as computers, phones, copiers, and printers. Occasional movement within the office may be required for task completion, including reaching, moving, and lifting objects up to forty (40) pounds.Location Requirements
Must be authorized to work in the country where the job is based.Background & Screening
Subject to program and location requirements, employees may be required to undergo a LEVEL II background and/or security investigation with fingerprinting. Drug screening may also be required (not applicable in Canada). Offers of employment are contingent upon successful completion of these investigations and screenings.Diversity & Inclusion
MCI embraces diversity and believes it enriches our employees, company, customers, and community. Employment decisions are based on merit, qualifications, and business needs. We maintain a discrimination-free work environment that fosters dignity and respect. All employees contribute to our commitment to equal opportunity. MCI does not discriminate based on age, ancestry, color, family or medical leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex, sexual orientation, or any other characteristic protected by law. We consider qualified applicants with criminal histories in accordance with applicable laws. Harassment of any kind is not tolerated. These principles guide all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, and discipline. Reasonable accommodations are provided to qualified individuals with disabilities as required by law.Company Overview
MCI empowers clients to address their CX and DX challenges through innovative solutions that deliver exceptional experiences and drive optimal performance. We provide business process outsourcing, staff augmentation, contact center services, and IT services. In 2019, MCI was recognized by Inc. Magazine as Iowa’s Fastest Growing Company and ranked 452nd on the Inc. 5000 list. Our subsidiaries have a history of appearing on Inc. Magazine's Fastest-Growing Companies list multiple times. MCI operates ten BPO service delivery facilities across various locations and employs over 10,000 individuals supporting over 150 North American clients through diverse brands. We drive modernization through digitalization, enabling clients to achieve more with less.Disclaimer
This job description provides a general overview and is not exhaustive. Duties and responsibilities may be added or modified by supervisors. Performance will be evaluated based on tasks performed. The employer reserves the right to revise this job description at any time. This description does not constitute an employment contract; either party may terminate employment at any time for any reason.Key skills/competency
AI Chatbot Tester, Chatbot Testing, Quality Assurance, Conversation Analysis, Prompt Engineering, User Acceptance Testing, Regression Testing, Customer Experience, BPO, Conversational AI.Skills & topics
- AI Chatbot Tester
- Chatbot Testing
- Quality Assurance
- Conversation Analysis
- AI
- Testing
- QA
- Customer Experience
- BPO
- Conversational AI
How to get hired
- Customize your resume: Highlight AI chatbot testing, QA, and customer experience skills relevant to MCI's needs.
- Complete the full application: Submit your resume, answer all screening questions, and take the pre-employment test on their careers page.
- Showcase analytical skills: Emphasize your attention to detail, problem-solving abilities, and experience documenting test outcomes.
- Demonstrate AI understanding: Mention any basic knowledge of AI and chatbot technologies, including prompt engineering if applicable.
- Prepare for interviews: Be ready to discuss your testing methodologies, collaboration experience, and customer-focused mindset.
Technical preparation
Familiarize yourself with chatbot testing methodologies.,Practice evaluating chatbot response quality.,Understand basic AI and conversational AI concepts.,Learn about prompt engineering principles if possible.
Behavioral questions
Describe a time you found a defect.,How do you handle conflicting feedback?,How do you ensure attention to detail?,Explain your problem-solving approach.
Frequently asked questions
- What is the main responsibility of an AI Chatbot Tester at MCI?
- The primary responsibility of an AI Chatbot Tester at MCI is to evaluate, validate, and improve AI-powered chatbot and conversational AI solutions, ensuring their responses are accurate, reliable, compliant, and meet user expectations.
- What qualifications are essential for the AI Chatbot Tester role at MCI?
- Essential qualifications include a Diploma or Bachelor's Degree in a related field, experience in software testing, QA, customer experience, or chatbot evaluation, strong attention to detail, excellent communication, and analytical skills. A basic understanding of AI and chatbot technologies is also required.
- Does MCI require a pre-employment test for the AI Chatbot Tester position?
- Yes, MCI requires candidates to complete a full application on their company careers page, which includes all screening questions and a brief pre-employment test.
- What 'nice to have' skills would make a candidate stand out for the AI Chatbot Tester job at MCI?
- Skills that would make a candidate stand out include experience testing AI chatbots or virtual assistants, knowledge of prompt engineering, familiarity with Generative AI, experience with QA management tools, exposure to conversational design, and understanding of AI evaluation metrics.
- What is the work environment like for an AI Chatbot Tester at MCI?
- The AI Chatbot Tester role operates in a professional office environment. The position is largely sedentary, requiring sitting or standing for extended periods while using a computer and headset, and involves regular operation of office equipment.
- What are MCI's diversity and inclusion policies for hiring an AI Chatbot Tester?
- MCI is committed to diversity and inclusion, ensuring all employment decisions are based on merit and qualifications. They maintain a discrimination-free workplace and do not discriminate on the basis of various protected characteristics, offering reasonable accommodations for individuals with disabilities.
- What is MCI's stance on background checks for AI Chatbot Tester applicants?
- Offers of employment are contingent upon the successful completion of a LEVEL II background and/or security investigation with fingerprinting, as well as a drug screening (where applicable).
- Can I apply for the AI Chatbot Tester role if I am an international applicant?
- Candidates must be authorized to work in the country where the job is based. MCI has multiple service delivery facilities internationally, but specific location authorization is required for each position.