PitchMeAI
MCI

AI Chatbot Tester

MCI · United States

  • Hybrid
  • Full-time
  • $75,000 / year
  • United States
Tailored resumekeyword-matched to this role.
Hiring managerwe find who's hiring.
Intro emaildrafted to reach them directly.

Job highlights

  • Test and validate AI chatbot functionality and responses.
  • Ensure chatbot accuracy, reliability, and compliance.
  • Analyze conversations and recommend improvements.
  • Collaborate with AI trainers and prompt engineers.
  • Contribute to chatbot optimization and best practices.

About the role

About MCI

MCI is a rapidly growing tech-enabled business services company with a significant call center presence and international operations. We offer Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across diverse industries like healthcare, retail, government, education, telecom, technology, e-commerce, and financial services. Our contact centers utilize both on-site and remote agents, employing advanced technologies to enhance customer interactions, ensure scalability, and manage costs.

At MCI, we are dedicated to creating an environment where professionals can develop fulfilling careers, access ongoing learning and development, and contribute to a leading global organization.

Job Summary

We are looking for an AI Chatbot Tester to evaluate, validate, and enhance AI-powered chatbot and conversational AI solutions. This role is crucial for ensuring that chatbot responses are accurate, reliable, compliant, and meet business requirements and user expectations. The successful candidate will be instrumental in upholding quality standards and improving customer experiences in AI-driven communications.

Key Responsibilities

Chatbot Testing & Validation
  • Execute test plans and chatbot evaluation scenarios.
  • Assess response quality and conversational effectiveness.
  • Validate chatbot functionality across various use cases.
  • Identify defects, inconsistencies, and performance issues.

Quality Assurance

  • Conduct regression and user acceptance testing.
  • Verify compliance with business requirements.
  • Document test results and findings.
  • Support issue resolution activities.

Conversation Analysis

  • Review chatbot interactions and user journeys.
  • Identify gaps in conversational flows.
  • Recommend improvements to responses and workflows.
  • Analyze trends and recurring issues.

Collaboration & Reporting

  • Work closely with AI trainers and prompt engineers.
  • Provide testing feedback to development teams.
  • Participate in quality review sessions.
  • Prepare reports and performance insights.

Continuous Improvement

  • Support chatbot optimization initiatives.
  • Contribute to testing standards and best practices.
  • Stay informed about conversational AI developments.
  • Assist with evaluation framework improvements.

Candidate Profile

We encourage all positive and driven applicants to apply. Ideal candidates are highly motivated, dedicated, and possess the following qualities:
  • Diploma or Bachelor's Degree in Information Technology, Quality Assurance, Communications, Business, or a related field.
  • Experience in software testing, QA, customer experience, or chatbot evaluation.
  • Strong attention to detail.
  • Excellent written communication skills.
  • Analytical and problem-solving abilities.
  • Experience documenting defects and test outcomes.
  • Ability to follow testing methodologies and processes.
  • Strong organizational skills.
  • Ability to work independently and collaboratively.
  • Basic understanding of AI and chatbot technologies.
  • Experience using productivity and reporting tools.
  • Customer-focused mindset.

Nice to Have

  • Experience testing AI chatbots or virtual assistants.
  • Knowledge of prompt engineering principles.
  • Familiarity with Generative AI technologies.
  • Experience with QA management tools.
  • Exposure to conversational design principles.
  • Knowledge of user experience testing methodologies.
  • Experience within technology or BPO environments.
  • Understanding of AI evaluation metrics.

Work Environment

This position operates in a professional office setting. The role involves prolonged periods of sitting and/or standing while using a computer and telephone headset. Employees will regularly operate office equipment such as computers, phones, copiers, and printers. Occasional movement within the office may be required for task completion, including reaching, moving, and lifting objects up to forty (40) pounds.

Location Requirements

Must be authorized to work in the country where the job is based.

Background & Screening

Subject to program and location requirements, employees may be required to undergo a LEVEL II background and/or security investigation with fingerprinting. Drug screening may also be required (not applicable in Canada). Offers of employment are contingent upon successful completion of these investigations and screenings.

Diversity & Inclusion

MCI embraces diversity and believes it enriches our employees, company, customers, and community. Employment decisions are based on merit, qualifications, and business needs. We maintain a discrimination-free work environment that fosters dignity and respect. All employees contribute to our commitment to equal opportunity. MCI does not discriminate based on age, ancestry, color, family or medical leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex, sexual orientation, or any other characteristic protected by law. We consider qualified applicants with criminal histories in accordance with applicable laws. Harassment of any kind is not tolerated. These principles guide all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, and discipline. Reasonable accommodations are provided to qualified individuals with disabilities as required by law.

Company Overview

MCI empowers clients to address their CX and DX challenges through innovative solutions that deliver exceptional experiences and drive optimal performance. We provide business process outsourcing, staff augmentation, contact center services, and IT services. In 2019, MCI was recognized by Inc. Magazine as Iowa’s Fastest Growing Company and ranked 452nd on the Inc. 5000 list. Our subsidiaries have a history of appearing on Inc. Magazine's Fastest-Growing Companies list multiple times. MCI operates ten BPO service delivery facilities across various locations and employs over 10,000 individuals supporting over 150 North American clients through diverse brands. We drive modernization through digitalization, enabling clients to achieve more with less.

Disclaimer

This job description provides a general overview and is not exhaustive. Duties and responsibilities may be added or modified by supervisors. Performance will be evaluated based on tasks performed. The employer reserves the right to revise this job description at any time. This description does not constitute an employment contract; either party may terminate employment at any time for any reason.

Key skills/competency

AI Chatbot Tester, Chatbot Testing, Quality Assurance, Conversation Analysis, Prompt Engineering, User Acceptance Testing, Regression Testing, Customer Experience, BPO, Conversational AI.

Skills & topics

  • AI Chatbot Tester
  • Chatbot Testing
  • Quality Assurance
  • Conversation Analysis
  • AI
  • Testing
  • QA
  • Customer Experience
  • BPO
  • Conversational AI

How to get hired

  • Customize your resume: Highlight AI chatbot testing, QA, and customer experience skills relevant to MCI's needs.
  • Complete the full application: Submit your resume, answer all screening questions, and take the pre-employment test on their careers page.
  • Showcase analytical skills: Emphasize your attention to detail, problem-solving abilities, and experience documenting test outcomes.
  • Demonstrate AI understanding: Mention any basic knowledge of AI and chatbot technologies, including prompt engineering if applicable.
  • Prepare for interviews: Be ready to discuss your testing methodologies, collaboration experience, and customer-focused mindset.

Technical preparation

Familiarize yourself with chatbot testing methodologies.,Practice evaluating chatbot response quality.,Understand basic AI and conversational AI concepts.,Learn about prompt engineering principles if possible.

Behavioral questions

Describe a time you found a defect.,How do you handle conflicting feedback?,How do you ensure attention to detail?,Explain your problem-solving approach.

Frequently asked questions

What is the main responsibility of an AI Chatbot Tester at MCI?
The primary responsibility of an AI Chatbot Tester at MCI is to evaluate, validate, and improve AI-powered chatbot and conversational AI solutions, ensuring their responses are accurate, reliable, compliant, and meet user expectations.
What qualifications are essential for the AI Chatbot Tester role at MCI?
Essential qualifications include a Diploma or Bachelor's Degree in a related field, experience in software testing, QA, customer experience, or chatbot evaluation, strong attention to detail, excellent communication, and analytical skills. A basic understanding of AI and chatbot technologies is also required.
Does MCI require a pre-employment test for the AI Chatbot Tester position?
Yes, MCI requires candidates to complete a full application on their company careers page, which includes all screening questions and a brief pre-employment test.
What 'nice to have' skills would make a candidate stand out for the AI Chatbot Tester job at MCI?
Skills that would make a candidate stand out include experience testing AI chatbots or virtual assistants, knowledge of prompt engineering, familiarity with Generative AI, experience with QA management tools, exposure to conversational design, and understanding of AI evaluation metrics.
What is the work environment like for an AI Chatbot Tester at MCI?
The AI Chatbot Tester role operates in a professional office environment. The position is largely sedentary, requiring sitting or standing for extended periods while using a computer and headset, and involves regular operation of office equipment.
What are MCI's diversity and inclusion policies for hiring an AI Chatbot Tester?
MCI is committed to diversity and inclusion, ensuring all employment decisions are based on merit and qualifications. They maintain a discrimination-free workplace and do not discriminate on the basis of various protected characteristics, offering reasonable accommodations for individuals with disabilities.
What is MCI's stance on background checks for AI Chatbot Tester applicants?
Offers of employment are contingent upon the successful completion of a LEVEL II background and/or security investigation with fingerprinting, as well as a drug screening (where applicable).
Can I apply for the AI Chatbot Tester role if I am an international applicant?
Candidates must be authorized to work in the country where the job is based. MCI has multiple service delivery facilities internationally, but specific location authorization is required for each position.