Senior AI DevOps Specialist

Senior AI DevOps Specialist at Boston University

At Boston University, we are assembling a world-class AI Engineering team to transform operations, drive innovation, and deliver innovative AI applications and agents. This is your chance to work on cutting-edge technologies like Agentic AI frameworks, LLMs, RAG, MCP, scalable AI architectures, and develop solutions at the forefront of modern artificial intelligence.

You will join as the Senior AI DevOps Specialist where you will ensure the scalable deployment, monitoring, and support of AI applications, agents, and models, while also contributing to development efforts in collaboration with other full-stack developers. You will focus on managing infrastructure across on-premises, cloud, and hybrid environments, integrating containerization technologies, and supporting advanced AI workflows. This position is primarily remote with periodic in-person meetings on campus. As a member of the AI Engineering team, you will handle some of the university's highest priority initiatives. You'll bring your expertise to a vibrant environment that values ingenuity and impact, where your ideas can make a difference on a global scale. Together, we'll deliver AI solutions that not only revolutionize university operations but also become models of innovation for institutions worldwide. Join us to make history, develop transformative technology, and work alongside some of the greatest minds in academia and technology. Be part of the team that will define what's possible in AI for academia and beyond.

Key Responsibilities

• Deployment of AI Applications, Agents & Related Infrastructure
• Collaborative Development Support
• AI Model Management & Fine-Tuning
• Infrastructure Monitoring & Optimization
• Security, Compliance, & Continuous Improvement

Required Skills

You Will Have:

• 8+ years of applicable experience.
• Degree in Computer Science, Software Engineering, Systems Engineering, or a related field.
• Expertise in containerization (Docker, Kubernetes, AWS ECS) and multi-environment deployment (on-premise, cloud, hybrid).
• Experience with hosting and fine-tuning LLM/SLM models.
• Development experience in modern programming languages (e.g., Python, JavaScript, or similar) with familiarity in AI technologies and frameworks (e.g., prompt engineering, RAG, embeddings along with more recent innovations like MCP and A2A).
• Experience with DevOps practices, scalable architectures, and modern security standards.

Benefits at Boston University

Boston University offers an excellent benefits package, including:

• Time Off: In addition to PTO and leave policy, BU employees have a paid intersession break and 13 paid holidays.
• Retirement: University-funded retirement plan with full vesting after 2 years of eligible service.
• Tuition Assistance Program: Competitive tuition assistance program for yourself and family members.

Boston University IS&T invests in our staff and their personal and professional growth. We promote staff learning including lunch and learn sessions, an extensive library of online courses, Fun Advisory Board (FAB) arranges a number of events throughout the year, and opportunities to engage with peers at NERCOMP and EDUCAUSE events.

Key skills/competency

• AI Deployment
• DevOps
• Containerization
• Kubernetes
• LLM Fine-tuning
• Cloud Infrastructure
• Python
• Scalable Architectures
• Security Standards
• RAG