Incident management / reliability / SRE Evaluator (Train AI Models Part Time!)
hackajob · United States
- Hybrid
- Full-time
- $40,000 / year
- United States
✓ Hiring manager found for this role
Email the hiring manager to get a response.
Get their verified email + an intro that's ready to send.
Incident management / reliability / SRE Evaluator (Train AI Models Part Time!)
hackajob · United States
Riley Chen
Hiring Manager · h•••••@hackajob.com
✍️ Your intro emailReady to send
Subject: Interested in the Incident management / reliability / SRE Evaluator (Train AI Models Part Time!) role at hackajob
Hi Riley — I came across the Incident management / reliability / SRE Evaluator (Train AI Models Part Time!) opening and wanted to reach out directly. I've spent the last few years doing exactly this kind of work, and hackajob stood out because…
🔒 Unlock to read & send
✎ Personalized to your résumé after sign-up.
$1 once
Just this hiring manager
Best value
$9/mo
Unlimited — any job, anywhere
- ✓ Verified email of the hiring manager
- ✓ Intro email personalized to your résumé
- ✓ $9/mo = unlimited — any job link
Secure checkout · cancel anytime
View the original posting ↗
Not recommended alone — most applicants never hear back.
Job highlights
- Evaluate AI-generated work products.
- Assess accuracy, rigor, and domain quality.
- Apply expertise in Incident Management/SRE.
- Provide structured written feedback.
- Remote, hourly, part-time engagement.
About the role
About the role
We are hiring expert Evaluators in **Incident management / reliability / SRE** to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement.Requirements (must have)
- 5+ years of relevant professional experience in Incident management / reliability / SRE.
- Native or professional fluency in English.
- Highly proficient in Microsoft Office and Google Workspace, especially Slides (Google Slides / PowerPoint).
Preferred (nice to have)
- Advanced degree (Master's or higher) from a reputable institution.
What you'll do
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
Key skills/competency
- Incident Management
- Reliability Engineering
- Site Reliability Engineering (SRE)
- AI Model Evaluation
- Content Review
- Quality Assurance
- Technical Writing
- Microsoft Office Proficiency
- Google Workspace Proficiency
- English Fluency
Skills & topics
- Incident Management
- Reliability Engineering
- Site Reliability Engineering
- SRE
- AI Evaluation
- AI Training
- Technical Review
- Content Quality
- Remote Work
- Part-time
- English Fluency
- Google Slides
- PowerPoint
- Microsoft Office
How to get hired
- Tailor your resume: Highlight 5+ years of Incident Management, Reliability, or SRE experience. Emphasize English fluency and proficiency in Microsoft Office/Google Workspace, especially Slides.
- Craft a compelling application: Clearly articulate your subject-matter expertise and attention to detail in your cover letter. Mention any advanced degrees if applicable.
- Prepare for the evaluation: Be ready to discuss your experience in assessing technical documents and providing feedback. Understand the importance of accuracy and quality in AI outputs.
- Demonstrate technical skills: Showcase your ability to use tools like Google Slides and PowerPoint effectively during the interview process.
- Understand the role's impact: Emphasize how your expertise contributes to improving AI model performance and accuracy.
Technical preparation
Master Google Slides and PowerPoint features.,Review Incident Management/SRE best practices.,Practice evaluating technical documents for clarity.,Familiarize with AI quality assessment criteria.
Behavioral questions
Describe a complex incident you managed.,How do you ensure system reliability?,Explain a time you provided critical feedback.,How do you handle detailed quality reviews?
Prefer to apply the usual way?
Not recommended alone — most applicants never hear back. Email the hiring manager first.
Frequently asked questions
- What is the primary responsibility of an AI Evaluator for Incident Management/Reliability/SRE at hackajob?
- As an AI Evaluator, your primary responsibility will be to review and assess AI-generated content such as documents, spreadsheets, and slide decks for accuracy, rigor, and overall domain quality. You will use your extensive experience in Incident Management, Reliability, or SRE to grade these outputs.
- What qualifications are essential for this AI Evaluator role?
- You must have at least 5 years of relevant professional experience in Incident Management, Reliability, or SRE. Additionally, native or professional fluency in English and high proficiency in Microsoft Office and Google Workspace, particularly Slides, are required.
- Is this AI Evaluator position remote or on-site?
- This is a remote, hourly engagement, offering flexibility to work from anywhere.
- What type of work products will I be evaluating as an AI Evaluator?
- You will be evaluating AI-generated work products, including documents, spreadsheets, and slide decks. Your task is to ensure they meet specific quality standards within the domain of Incident Management, Reliability, and SRE.
- How does hackajob use my expertise as an Incident Management/Reliability/SRE Evaluator?
- hackajob collaborates with companies like Mercor to connect them with skilled professionals. Your expertise will directly contribute to training and improving AI models by providing accurate assessments and feedback on their generated content.
- What are the 'nice to have' qualifications for this role?
- While not mandatory, an advanced degree (Master's or higher) from a reputable institution is considered a preferred qualification for this AI Evaluator position.
- What specific skills are most important for a successful AI Evaluator in this role?
- Beyond your core Incident Management/Reliability/SRE expertise, strong proficiency in Microsoft Office (especially PowerPoint) and Google Workspace (especially Google Slides) is crucial. Excellent written communication skills for providing feedback are also key.