AI/MLOps RAG Specialist
Hitachi Digital
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
Our Company
We’re Hitachi Digital, a company at the forefront of digital transformation and the fastest growing division of Hitachi Group. We’re crucial to the company’s strategy and ambition to become a premier global player in the massive and fast-moving digital transformation market.
Our group companies, including GlobalLogic, Hitachi Digital Services, Hitachi Vantara and more, offer comprehensive services that span the entire digital lifecycle, from initial idea to full-scale operation and the infrastructure to run it on. Hitachi Digital represents One Hitachi, integrating domain knowledge and digital capabilities, and harnessing the power of the entire portfolio of services, technologies, and partnerships, to accelerate synergy creation and make real-world impact for our customers and society as a whole.
Imagine the sheer breadth of talent it takes to unleash a digital future. We don’t expect you to ‘fit’ every requirement – your life experience, character, perspective, and passion for achieving great things in the world are equally as important to us.
The Team
As an AI/MLOps RAG Specialist, you will own the end-to-end lifecycle of AI models and agents, focusing on deployment, monitoring, and optimization. You will leverage Google Cloud Platform (GCP) services and Vertex AI to build LLMOps pipelines, integrate RAG workflows, and enforce AI governance for transparency and reliability.
The Role of an AI/MLOps RAG Specialist
The AI/MLOps RAG Specialist will manage various critical aspects of AI operations, including pipeline management, RAG and agent optimization, observability, explainability, and cloud architecture integration.
ML Ops & Pipeline Management
- Design and implement LLMxOps/MLOps pipelines for model training, deployment, and lifecycle management.
- Automate CI/CD workflows for AI models using GCP-native tools.
- Manage model versioning, rollback strategies, and performance benchmarking.
AI RAG & Agent Optimization
- Architect and deploy Retrieval-Augmented Generation (RAG) pipelines for contextual AI responses.
- Optimize AI agent performance (latency, accuracy, cost) through prompt tuning, caching, and orchestration strategies.
- Integrate knowledge graphs, embeddings, and vector databases for semantic retrieval.
Observability & Explainability
- Implement AI observability frameworks for monitoring agent workflows, latency, and reliability.
- Develop explainability dashboards for model decisions, bias detection, and compliance reporting.
- Define evaluation metrics and safety tests for AI outputs.
Cloud Architecture & Integration
- Leverage GCP services (Vertex AI, Cloud Run, GKE, IAM, VPC-SC) for secure and scalable deployments.
- Integrate AI solutions with enterprise systems and APIs.
- Ensure compliance with data governance and regulatory standards.
What You’ll Bring
- Bachelor’s or master’s in computer science, AI/ML, or related field.
- 7+ years in ML Ops or AI platform engineering; 3+ years with GCP and Vertex AI.
- Hands-on experience with RAG architectures, LLMs, and Agentic AI workflows.
- Strong programming skills in Python and familiarity with Node.js for orchestration.
- Expertise in observability tools, model monitoring, and explainability frameworks.
- Knowledge of vector databases, embeddings, and semantic search.
Preferred Qualifications
- Certifications: Google Professional Cloud Architect, Machine Learning Engineer.
- Experience with LangChain, agent orchestration frameworks, and evaluation harnesses.
- Familiarity with data governance, bias detection, and AI safety protocols.
- Exposure to GPU optimization and cost-performance tuning.
Key Competencies
- Strong problem-solving and analytical skills.
- Ability to design scalable, secure, and explainable AI systems.
- Collaborative mindset with excellent communication skills.
- Passion for AI reliability, observability, and responsible AI practices.
Success Metrics
- Deployment of production-ready RAG pipelines integrated with enterprise workflows.
- Established AI observability dashboards and explainability reports.
- Reduction in model incident rates and improved response accuracy.
- Positive impact on AI governance and compliance readiness.
What You’ll Work With
- Cloud & AI: GCP, Vertex AI, Cloud Run, GKE.
- ML Ops Tools: CI/CD pipelines, monitoring frameworks, evaluation harnesses.
- Data & Retrieval: Vector databases, embeddings, semantic search.
- Agentic AI: Multi-agent orchestration, prompt optimization, RAG workflows.
About Us
We’re a global, 1000-strong, diverse team of professional experts, promoting and delivering Social Innovation through our One Hitachi initiative (OT x IT x Product) and working on projects that have a real-world impact. We’re curious, passionate and empowered, blending our legacy of 110 years of innovation with our shaping our future. Here you’re not just another employee; you’re part of a tradition of excellence and a community working towards creating a digital future.
Fostering Innovation Through Diverse Perspectives
Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth. We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.
How We Look After You
We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.
We’re proud to say we’re an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.
Key skills/competency
- MLOps
- RAG Architectures
- Google Cloud Platform (GCP)
- Vertex AI
- LLM/AI Agent Optimization
- CI/CD Automation
- AI Observability
- Explainability Frameworks
- Python Programming
- Vector Databases
How to Get Hired at Hitachi Digital
- Research Hitachi Digital's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Customize your resume to highlight experience in MLOps, RAG, and GCP, using keywords from the job description.
- Showcase AI/ML expertise: Prepare to discuss specific projects involving LLMs, Vertex AI, and AI agent optimization in detail.
- Demonstrate problem-solving: Practice articulating how you've designed scalable, secure, and explainable AI systems in past roles.
- Highlight collaboration and passion: Emphasize your collaborative mindset and commitment to responsible AI practices.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background