AI Plattform Engineer

About the Role

For a long-term Artificial Intelligence project, an experienced consultant (m/w/d) is sought to serve as an AI Plattform Engineer. This role involves the establishment, ongoing development, and stable operation of a modern on-premise language model platform.

This engagement takes place within the environment of a large public IT service provider.

Your Responsibilities:

• Establish and maintain a scalable on-premise language model platform for generative AI.
• Set up, document, and manage a RAG-Chat application in container environments (e.g., OpenShift).
• Integrate user authentication and modular extension capabilities for the platform.
• Ensure stable platform operation, including resource monitoring, log analysis, and error resolution.
• Develop data and analysis pipelines for data extraction, transformation, enrichment, and storage in vector and NoSQL databases.
• Build specialized knowledge databases (data modeling, indexing, semantic search).
• Develop a central interface (API) for connecting chatbots, browser extensions, IDEs, and Office tools to SQL, NoSQL, and vector databases.
• Document all technical activities and maintain close coordination with the project team.

Your Profile:

• More than 8 years of project experience in Artificial Intelligence, demonstrable through project references.
• At least 5 years of professional Python programming experience (data processing, AI, automation).
• At least one completed practical project as an AI Plattform Engineer (e.g., building AI infrastructure, MLOps, GenAI platforms).
• Ability to develop and operate on-premise AI solutions (GPU environments, container platforms).
• Experience in building and operating a RAG-Chat solution and developing data pipelines.
• Knowledge of modern AI frameworks, including vLLM, vector databases, and container orchestration.
• Advantage: Experience in IT projects for public administration.
• Very good German and English language skills, both written and spoken.

Desired (Nice-to-Have):

• Experience with On-Premise AI Systems (Dev & Ops).
• Experience with RAG solutions.
• Experience with data and analysis pipelines.
• Knowledge of modern AI frameworks, including vLLM.
• Project knowledge in financial administration.

Other Details

• Duration: Framework agreement until 2030
• Work Location: On-site presence expected less than one day per month, Remote/Germany

In Summary

This role is ideal for you if you:

• Have experience with Artificial Intelligence and have successfully implemented complex AI projects.
• Have experience with RAG solutions.
• Possess strong Python programming skills (min. 5 years).
• Have experience building data pipelines and working with vector and NoSQL databases.
• Possess knowledge of modern AI frameworks, including vLLM.

Key skills/competency

• AI Platform Development
• Generative AI
• On-premise Solutions
• Language Models
• RAG-Chat Applications
• Python Programming
• OpenShift
• vLLM
• Vector Databases
• MLOps