Senior AI Platform Engineer

Job Purpose and Impact

As a Senior AI Platform Engineer for AI Assistants & AI Agents at Cargill, you will play a critical role in maintaining the safety, currency, and high performance of Cargill’s enterprise AI-assistant platform. This platform includes crucial components like ChatGPT Enterprise, M365 Copilots, and agentic-automation runtimes. Your responsibilities will encompass configuration management, version upgrades, license and quota governance, user-onboarding flows, and providing first-line Site Reliability Engineering (SRE) support for the platform’s core services and audit pipelines.

Success in this role is directly measured by achieving zero unplanned downtime during platform upgrades, ensuring a 99.9% platform availability, producing audit-ready compliance artifacts, and maintaining positive Net Promoter Scores (NPS) from both user and builder teams across Cargill.

Key Accountabilities

• Plan, test, and execute rolling upgrades for LLM runtimes, agent-orchestration frameworks, and all supporting services to ensure seamless operation and integration.
• Enforce stringent Identity and Access Management (IAM) policies, manage secrets rotation, ensure data classification adherence, and uphold Responsible AI guardrails to maintain platform security and ethical standards.
• Proactively track license usage and optimize expenditure to ensure cost-efficiency without compromising platform capabilities.
• Instrument and monitor Service Level Indicators (SLIs), such as authentication latency and inference success rates, to consistently meet and uphold defined Service Level Objectives (SLOs).
• Analyze critical performance metrics including GPU/CPU utilization, prompt accuracy, effectiveness of evaluation frameworks, vector-search query latency, and agent throughput.
• Implement robust auto-scaling policies, intelligent caching mechanisms, and develop comprehensive cost-control dashboards to enhance platform efficiency and manage operational costs.
• Develop concise how-to guides and conduct live workshops to effectively upskill product squads on best practices for safe prompt engineering, RAG (Retrieval Augmented Generation) patterns, and leveraging platform APIs.

Qualifications

To be successful in this role, candidates should meet the following qualifications:

• Minimum of 4 years of relevant work experience, with typical candidates possessing 5 years or more of pertinent experience in similar roles.

Preferred Qualifications

• A strong preference for candidates with 6 years or more of experience in the administration of Enterprise AI SaaS applications.

Key skills/competency

• AI Platform Management
• ChatGPT Enterprise
• M365 Copilot
• Agentic Automation
• Site Reliability Engineering (SRE)
• Configuration Management
• License Governance
• IAM & Security
• LLM Runtimes
• Prompt Engineering