DevOps and LLM Ops Manager

DevOps and LLM Ops Manager at Uplers (Client: AI company working with Indian Police)

This full-time hybrid position, located in the Greater Chennai Area, with some work from home acceptable, is for an AI company working with Indian Police pan India, client of Uplers.

Experience and Compensation

• Experience: 3+ years
• Salary: INR 1,200,000-1,500,000 per year (based on experience)
• Expected Notice Period: 15 Days
• Shift: (GMT+05:30) Asia/Kolkata (IST)

About the Client

The client is an AI company empowering law enforcement and intelligence agencies with real-time, contextual data. Their solutions uncover hidden connections and patterns, proactively manage law and order situations, and significantly reduce the time needed for knowledge, analysis, and action, ultimately improving policing outcomes.

Role Description

As the DevOps and LLM Ops Manager, you will oversee daily DevOps tasks, manage software deployments, and ensure continuous integration and delivery pipelines. Key responsibilities include maintaining system performance, optimizing cloud infrastructure, and collaborating closely with development teams to implement best practices. You will also play a crucial role in supporting AI/ML operations and managing large language models (LLM) to enhance product functionality.

Key Responsibilities

• Design, build, and maintain robust CI/CD pipelines using GitHub Actions.
• Manage and monitor cloud infrastructure across Azure and on-premise systems.
• Automate infrastructure and configuration with tools like Terraform or Ansible.
• Work with monitoring tools such as Grafana, Prometheus, and Loki.
• Collaborate with AI/ML engineers to deploy, scale, and monitor LLM-based services using vLLM or similar frameworks.
• Optimize system reliability, scalability, and performance for AI inference and training workflows.
• Implement best practices for secrets management, observability, and incident response.

Requirements

• 3–5 years of hands-on experience in DevOps, SRE, or Cloud Infrastructure roles.
• Deep understanding of GitHub Actions, workflows, runners, and reusable pipelines.
• Strong experience with Docker, Kubernetes, and container orchestration.
• Proficiency in scripting languages like Bash and Python.
• Exposure to AI/ML pipelines, LLM models, or MLOps is a significant advantage.
• Solid understanding of networking, security, and system design.
• Proficient in managing on-prem systems.

Nice-to-Have

• Experience integrating with HuggingFace, OTEL, .Net Core, NodeJS.
• Familiarity with model serving tools like Triton, Ray Serve, or TorchServe.
• Contributions to open-source projects or published DevOps/ML blogs.

How to Apply

Step 1: Click On Apply! And Register or Login on our portal.Step 2: Complete the Screening Form & Upload updated ResumeStep 3: Increase your chances to get shortlisted & meet the client for the Interview!

About Uplers

Uplers aims to make hiring reliable, simple, and fast. They support talents in finding and applying for relevant contractual onsite opportunities and progressing in their careers, providing assistance with any grievances or challenges during engagement.

Key skills/competency

• DevOps
• LLM Operations
• CI/CD
• Kubernetes
• Terraform
• Azure
• Python
• Bash
• GitHub Actions
• Grafana