Grafana Specialist - Workflow Designer | Upto $150/hr Hourly
Mercor · India
This listing has closed — view similar roles below.
- Hybrid
- Part-time
- $150,000 / year
- India
Job highlights
- Design and implement complex Grafana workflows.
- Develop reference trajectories and verification methods.
- Write clear task prompts for AI agents.
- Assess AI agent performance and identify failures.
- Calibrate task difficulty for AI evaluation.
About the role
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Grafana Evaluation Task Designer
Type: Contract
Compensation: $90–$150/hour
Commitment: 10–15 hours/week
Role Responsibilities
- Design realistic, multi-step Grafana workflows, including dashboards, alerting rules, and data source configuration.
- Perform each workflow on a hosted Grafana instance to produce a reference trajectory.
- Write clear, specific task prompts with measurable outcomes for programmatic verification.
- Implement programmatic graders to check task completion accuracy.
- Review AI agent attempts, identify failures, and tag root causes.
- Calibrate task difficulty to ensure challenges are solvable, iterating on prompts based on model performance.
Qualifications
Must-Have
- 2+ years of daily, professional Grafana experience.
- Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration.
- Ability to articulate workflows for programmatic verification.
- Comfort writing basic grading scripts in Python.
Preferred
- Experience with Grafana API automation.
- Kubernetes/infrastructure monitoring background.
- Familiarity with AI evaluation or benchmarking.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Key skills/competency
- Grafana
- PromQL
- Dashboard Design
- Alerting
- Data Source Configuration
- Python Scripting
- Workflow Design
- AI Evaluation
- Task Design
- Technical Writing
Skills & topics
- Grafana
- PromQL
- Dashboarding
- Alerting
- Data Visualization
- Python
- AI Evaluation
- Workflow Design
- Technical Task Design
- Monitoring
- Contract
- Remote
How to get hired
- Tailor your resume: Highlight 2+ years of daily Grafana experience, PromQL, alerting, and Python.
- Prepare for AI interview: Be ready to discuss your workflow design experience and technical writing skills.
- Demonstrate technical skills: Showcase your ability to articulate workflows and write grading scripts.
- Understand Mercor's mission: Align your application with their goal of connecting talent to AI research labs.
Technical preparation
Master PromQL for complex queries.,Practice building Grafana dashboards and alerts.,Develop Python scripts for grading tasks.,Familiarize with Grafana API automation.
Behavioral questions
Describe a complex Grafana workflow you designed.,How do you ensure task prompts are measurable?,How do you calibrate difficulty for AI agents?,Share an experience reviewing AI agent failures.
Frequently asked questions
- What is the primary focus of the Grafana Specialist role at Mercor?
- The Grafana Specialist role at Mercor focuses on designing and implementing realistic, multi-step Grafana workflows, including dashboards and alerting rules, to evaluate AI agent performance.
- What technical skills are essential for this Grafana Specialist position?
- Essential technical skills include 2+ years of daily professional Grafana experience, deep familiarity with PromQL, dashboard templating, alerting pipelines, data source configuration, and comfort writing basic grading scripts in Python.
- How does Mercor use the Grafana workflows designed by specialists?
- Grafana workflows are used to create evaluation tasks for AI agents. Specialists design these workflows, perform them to create reference trajectories, and write prompts for programmatic verification of AI agent attempts.
- What is the application process for the Grafana Specialist role at Mercor?
- The application process involves uploading your resume, completing an AI interview based on your resume, and submitting the application form. The process takes approximately 20-30 minutes.
- What is the compensation for the Grafana Specialist role at Mercor?
- The Grafana Specialist role offers a compensation of $90–$150 per hour on a contract basis, with a commitment of 10-15 hours per week.
- What are the preferred qualifications for a Grafana Specialist at Mercor?
- Preferred qualifications include experience with Grafana API automation, a background in Kubernetes/infrastructure monitoring, and familiarity with AI evaluation or benchmarking.
- How often does Mercor review applications for the Grafana Specialist position?
- Mercor reviews applications daily. It is encouraged to complete all application steps, including the AI interview, promptly to be considered.
- Where can I find more information about Mercor's interview process?
- More information about the interview process and platform details can be found on Mercor's talent documentation site: https://talent.docs.mercor.com/welcome