Senior AI/ML Engineer
Haystack
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Senior AI/ML Engineer at Haystack
Join a pioneering civic-tech platform dedicated to modernizing government digital services. This Senior AI/ML Engineer role offers a unique opportunity to build the future of public service delivery by architecting production-grade AI capabilities into a high-impact no-code platform.
You will be instrumental in leading the transition from traditional workflows to intelligent automation. This involves leveraging advanced technologies like Azure OpenAI, GPT-4o, and sophisticated RAG pipelines to revolutionize how government agencies process information at scale.
The Role
- Lead the design and deployment of production ML infrastructure using Python and .NET 8 integration layers.
- Architect and optimize vector-based retrieval pipelines (RAG) using OpenAI embeddings and Azure AI Search.
- Design advanced prompt engineering strategies and AI agents to translate complex PDF data into structured schemas.
- Implement RLHF (Reinforcement Learning from Human Feedback) loops to continuously improve model accuracy and performance.
- Collaborate with full-stack teams to deploy scalable AI services on Kubernetes (AKS) and Azure cloud infrastructure.
What You'll Need
- 5+ years of experience in applied Machine Learning with a focus on delivering production-ready AI products.
- Expert-level Python skills and experience building production-grade ML pipelines and orchestration.
- Proven expertise in Large Language Models (LLMs), fine-tuning models for structured JSON output, and RAG workflows.
- Strong background in vector databases and hybrid search technologies like Azure AI Search or CosmosDB.
- System-level engineering mindset with the ability to bridge the gap between probabilistic AI and reliable enterprise APIs.
What's On Offer
- Competitive salary range of $140,000 - $180,000 per year.
- 100% Remote flexibility (US-based) with a focus on real-world impact rather than just R&D experiments.
- Opportunity to lead greenfield AI development on a proven, profitable enterprise platform.
- Comprehensive healthcare coverage including Vision and Dental for you and your family.
Key skills/competency
- Machine Learning
- AI Architecture
- Python
- Large Language Models (LLMs)
- RAG Pipelines
- Azure OpenAI
- Prompt Engineering
- Kubernetes (AKS)
- Vector Databases
- Production ML
How to Get Hired at Haystack
- Research Haystack's mission: Understand their civic-tech focus, values, and impact on government digital services.
- Tailor your resume: Highlight extensive experience with LLMs, RAG, Python, Azure AI, and production ML pipelines.
- Showcase AI architecture skills: Prepare to discuss past projects involving scalable AI deployments and intelligent automation.
- Demonstrate problem-solving: Articulate how you bridge probabilistic AI with reliable enterprise solutions during interviews.
- Network effectively: Connect with Haystack employees on LinkedIn to gain insights into their engineering culture.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background