Software Engineer, AI Platform

About Salesforce

Salesforce is the #1 AI CRM, driving customer success with AI agents. Here, ambition meets action, tech meets trust, and innovation is a way of life. We're seeking Trailblazers passionate about improving business and the world through AI, driving innovation, and upholding Salesforce's core values.

Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.

About Slack AI

Slack AI's mission is to transform how people work by making Slack an AI-powered operating system. We're tackling significant challenges like unlocking collective knowledge and reducing noise, all while building a seamless, consumer-grade AI experience within users' existing workflows. Join us in shaping the future of work through AI.

About The Team

The AI and ML Infrastructure team, part of Slack’s Core Infrastructure, is responsible for foundational systems enabling machine learning and AI across the company. The team designs, builds, and operates reliable, scalable, and high-performance platforms, allowing product and ML teams to confidently develop, deploy, and operate AI-driven capabilities.

This team owns shared infrastructure, services, and tooling supporting the full ML lifecycle, including model training, deployment, inference, and monitoring. As Slack AI grows, the team is evolving from traditional ML deployments toward large-scale, highly distributed model systems. This involves deep architectural decisions for scalable model deployment, real-time feature serving at high throughput, GPU-accelerated inference at message scale, and responsible training of models on sensitive data with strong privacy and safety requirements.

Core Focus Areas

ML Infrastructure - This area focuses on low-level systems powering training and inference at scale. This includes architecting and maintaining distributed systems for model training, serving, and deployment using Kubernetes-based platforms, GPU infrastructure, and open-source ML stacks like KubeRay and vLLM. The team delivers platform capabilities that enhance the speed, reliability, and quality of ML development, including training pipelines, feature generation systems, and compute orchestration.

AI Platform - This area builds tooling and platform layers enabling AI development across Slack. This includes creating developer-facing tools, SDKs, and workflows for product teams to integrate AI into Slack features efficiently and safely. The platform supports LLM efficiency and model transition initiatives through integrations with managed services across multiple cloud providers, acting as the connective layer between core infrastructure and product engineering teams.

About The Role

We are looking for Software Engineers to join the AI Platform effort and build the developer experience that powers AI at Slack. In this role, you will treat internal engineers as your primary customers, designing and building tooling, SDKs, and evaluation frameworks that enable product teams to ship AI features faster and more reliably.

You will work closely with ML Infrastructure, modeling, and product teams to make informed decisions around open-source versus managed solutions, improve the usability and reliability of our AI platforms, and accelerate the adoption of AI across Slack.

What You’ll Be Doing

• Drive the evolution of Slack’s AI and ML platform toward a self-service, developer-friendly environment that improves velocity and reliability.
• Build and maintain SDKs, feature generation tools, and CI/CD pipelines that simplify AI integration for product teams.
• Manage and evolve integrations with managed AI services across multiple cloud providers.
• Design and operate AI quality evaluation frameworks and prompt engineering infrastructure to ensure high standards for AI features.
• Collaborate closely with ML modeling, AI quality, and product engineering teams to design platforms meeting evolving technical and business needs.

What You Should Have

• Experience building developer tooling, libraries, or CI/CD pipelines that enhance engineering speed, quality, and usability.
• Experience operationalizing Large Language Models (LLMs) and building integrations with first-party and external cloud provider APIs (AWS, GCP, Azure).
• Experience with AI quality evaluation frameworks, prompt engineering infrastructure, or developer tooling for ML workflows.
• Strong proficiency in Python, PHP or Hacklang and experience with infrastructure as code and modern software engineering practices.
• Ability to communicate complex technical concepts clearly and effectively to a broad range of stakeholders.
• Love to model modern methodologies for unit tests, code review, design documentation, debugging, and troubleshooting.
• Are curious, inquisitive, and determined to fix things when they break.
• Work well with a team of diverse backgrounds and experience on complicated projects.
• A related technical degree required.

Key skills/competency

• AI Platform Development
• Machine Learning Infrastructure
• Developer Tooling
• Distributed Systems
• LLM Operationalization
• CI/CD Pipelines
• Prompt Engineering
• Evaluation Frameworks
• Python/PHP/Hacklang
• Cloud Computing (AWS/GCP/Azure)