Senior LLM RAG Engineer, Legacy Modernization
Grid Dynamics
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Role Overview
The Senior LLM RAG Engineer, Legacy Modernization will play a pivotal role in a high-profile modernization project, transitioning a legacy RPG/IBM i-based Dealer Management System (DMS) into a modern, cloud-native Java architecture.
In this Proof of Concept (POC) phase, you will specialize in CodeRAG (Retrieval-Augmented Generation for code) and Abstract Syntax Tree (AST) techniques. Your primary objective is to automate the parsing, transformation, and migration of legacy business logic into modern microservices. You will work at the intersection of Generative AI and legacy system modernization, ensuring that automated code generation remains accurate, performant, and aligned with architectural specifications.
Responsibilities
- Code Transformation & Analysis: Utilize AST techniques to parse legacy RPG code and transform it into structured formats suitable for automated migration.
- RAG Implementation: Design and maintain RAG pipelines using AWS Bedrock and Vector Databases to provide LLMs with high-fidelity context from legacy documentation and code analysis.
- Data Preprocessing: Clean, structure, and enrich metadata from legacy systems, potentially involving the creation of knowledge graphs or embeddings to improve LLM accuracy.
- Iterative Validation: Perform rigorous validation and correction of AI-generated code assets to ensure they meet modern Java standards and functional parity with the legacy system.
- Legacy Integration: Collaborate with specialized code analysis tools (such as PKS eXplain) to extract business logic and code flows from IBM i environments.
- Collaboration & Documentation: Work closely with cross-functional teams in India and Germany, documenting complex business logic and ensuring tight feedback loops during the POC.
- Quality Assurance: Adhere to strict architectural specifications and collaborate on testing strategies to validate the migrated solution.
Requirements
- Total Work Experience: Minimum of 4–8 years of experience in software engineering, with a significant focus on AI/ML or Backend development.
- AI & LLM Expertise: Proven experience working with advanced LLMs (e.g., Claude 3.5/3.7/4) and building RAG pipelines.
- Technical Proficiency:
- Languages: Strong proficiency in Python.
- Cloud: Hands-on experience with AWS Bedrock.
- Databases: Experience with Vector Databases such as Milvus or Pinecone.
- Code Transformation Skills: Deep understanding of Abstract Syntax Trees (AST) and experience in parsing or transforming code programmatically.
- Modernization Knowledge: Familiarity with code migration processes, microservices architecture, and cloud-native design patterns.
- Tools & Version Control: Expert-level knowledge of Git for managing generated code and collaborative development.
- Soft Skills: A proactive nature with strong communication skills, essential for navigating the ambiguity of a POC environment and working with distributed global teams.
What We Offer
- Opportunity to work on bleeding-edge projects
- Work with a highly motivated and dedicated team
- Competitive salary
- Flexible schedule
- Benefits package - medical insurance, sports
- Corporate social events
- Professional development opportunities
- Well-equipped office
About Grid Dynamics
Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
Key skills/competency
- LLMs
- RAG Pipelines
- Abstract Syntax Tree (AST)
- Code Modernization
- Python
- AWS Bedrock
- Vector Databases
- Microservices Architecture
- Generative AI
- Git
How to Get Hired at Grid Dynamics
- Research Grid Dynamics' culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Customize your resume to highlight experience with LLMs, RAG, AST, Python, AWS Bedrock, and legacy modernization relevant to the Senior LLM RAG Engineer, Legacy Modernization role.
- Prepare for technical deep-dives: Expect questions on CodeRAG, AST, microservices, cloud-native Java, and vector databases, demonstrating your problem-solving skills.
- Showcase collaboration & communication: Emphasize experience working with distributed global teams and navigating complex POC environments effectively.
- Highlight your modernization impact: Be ready to discuss specific projects where you've successfully transitioned legacy systems or implemented AI solutions for code transformation.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background