REMOTE -Principal Software Developer- Agentic AI, Healthcare AI
Oracle · United States
- Hybrid
- Full-time
- $234,000 / year
- United States
Tailored resume — keyword-matched to this role.
Hiring manager — we find who's hiring.
Intro email — drafted to reach them directly.
Job highlights
- Develop advanced AI systems using LLMs and agents.
- Build scalable retrieval and knowledge systems.
- Design and operate production-grade AI services.
- Collaborate with cross-functional teams on AI solutions.
- Drive AI architecture and engineering standards.
About the role
About the Role
Oracle is seeking a Principal Software Developer to join their Agentic AI team, focusing on AI systems for Healthcare. This role involves architecting, designing, developing, and operating production-grade AI systems powered by LLMs, agents, retrieval, and enterprise data. You will build agentic AI systems that leverage tool use, memory, planning, orchestration, and workflow automation to solve complex business problems. Your responsibilities will include designing and implementing scalable RAG, search, retrieval, ranking, and knowledge systems across various data sources, and developing LLM-powered applications.
Key Responsibilities
- Architect, design, develop, deploy, and operate production-grade AI systems powered by LLMs, agents, retrieval, and enterprise data.
- Build agentic AI systems that leverage tool use, memory, planning, orchestration, and workflow automation to solve complex business problems.
- Design and implement scalable RAG, search, retrieval, ranking, and knowledge systems across structured and unstructured data sources.
- Develop LLM-powered applications, including prompt and context engineering, tool integrations, model routing, guardrails, and workflow orchestration.
- Optimize AI systems for quality, latency, reliability, scalability, observability, and cost efficiency.
- Establish evaluation frameworks, experimentation platforms, and feedback loops to continuously improve AI system performance and user outcomes.
- Build and maintain cloud-native services, APIs, SDKs, and distributed systems that enable reliable development and operation of AI capabilities.
- Design and support asynchronous communication patterns, event-driven architectures, and workflow orchestration using messaging and streaming technologies.
- Partner closely with applied scientists, engineers, product managers, and domain experts to translate ambiguous requirements into scalable technical solutions.
- Drive architecture decisions, mentor engineers, and raise engineering standards across the organization.
Qualifications
- 8+ years of professional experience in software engineering, machine learning engineering, applied machine learning, or related fields.
- BS/MS/PhD in Computer Science, Engineering, Machine Learning, Artificial Intelligence, or equivalent practical experience.
- Proven track record of designing, building, and operating production ML, AI, LLM, RAG, search, recommendation, conversational AI, or agentic AI systems at scale.
- Strong software engineering fundamentals, including distributed systems, concurrency, APIs, data structures, algorithms, testing, debugging, and production operations.
- Proficiency in Python and Java with experience developing and maintaining production software in both languages.
- Hands-on experience building scalable backend services, cloud-native systems, APIs, distributed applications, or model-serving platforms.
- Experience with modern LLM ecosystems, including prompt engineering, tool calling, retrieval-augmented generation, model serving, evaluation, and deployment.
- Experience building search, retrieval, ranking, vector database, or enterprise knowledge systems.
- Experience with asynchronous communication patterns, message queues, pub/sub systems, data streaming platforms, or event-driven architectures.
- Experience with containerized applications and Kubernetes-based deployments.
- Strong technical judgment and the ability to balance quality, latency, reliability, scalability, and cost tradeoffs.
- Demonstrated ownership of complex technical problems from architecture through production operation.
- Strong communication skills and experience working effectively across engineering, product, and applied science teams.
Preferred Qualifications
- Experience building agentic AI systems involving planning, tool orchestration, memory, autonomous workflows, or multi-agent architectures.
- Experience with frameworks and platforms such as LangGraph, LangChain, LlamaIndex, Semantic Kernel, MCP, or equivalent orchestration technologies.
- Experience with retrieval and ranking technologies such as Elasticsearch, OpenSearch, vector databases, hybrid search, reranking, and query understanding systems.
- Experience designing and operating production LLM serving platforms with responsibility for latency, throughput, reliability, scalability, observability, and cost efficiency.
- Experience with model adaptation techniques such as fine-tuning, LoRA, distillation, preference optimization, or domain adaptation.
- Experience building evaluation systems, A/B testing frameworks, human-in-the-loop review processes, and AI quality measurement platforms.
- Experience with OCI, AWS, Azure, or GCP and technologies such as Docker, Kubernetes, Kafka, Spark, or equivalent distributed systems.
- Experience developing tools, frameworks, APIs, or platforms used by applied scientists, data scientists, or machine learning engineers.
- Experience building AI systems in healthcare, enterprise SaaS, regulated environments, or other privacy-sensitive domains.
- Demonstrated technical leadership through architecture ownership, mentoring, cross-functional collaboration, and delivery of high-impact initiatives.
Key skills/competency
- Agentic AI
- LLM
- RAG
- Software Engineering
- Python
- Java
- Cloud-Native Systems
- Distributed Systems
- Healthcare AI
- Production ML
Skills & topics
- Principal Software Developer
- Agentic AI
- Healthcare AI
- LLM
- RAG
- Machine Learning
- Software Engineering
- Python
- Java
- Cloud-Native
How to get hired
- Tailor your resume: Highlight experience with LLMs, agentic AI, RAG, and production ML systems, aligning with Oracle's qualifications.
- Showcase technical expertise: Emphasize your proficiency in Python and Java, distributed systems, and cloud-native technologies.
- Demonstrate operational excellence: Provide examples of designing, building, and operating AI systems at scale.
- Articulate your impact: Prepare to discuss complex technical problems you've solved and your leadership contributions.
- Understand Oracle's AI focus: Research Oracle's AI initiatives, especially in healthcare, to align your application and interview responses.
Technical preparation
Master Python and Java for production software.,Build and deploy distributed cloud-native systems.,Design and implement scalable RAG systems.,Develop LLM applications with prompt engineering.
Behavioral questions
Describe a complex AI system you built.,How do you balance system quality and cost?,Explain your experience mentoring junior engineers.,How do you collaborate with non-technical teams?
Frequently asked questions
- What specific AI technologies are central to this Principal Software Developer role at Oracle?
- This Principal Software Developer role at Oracle is centered around agentic AI, large language models (LLMs), retrieval-augmented generation (RAG), and building scalable AI systems for healthcare applications. You'll be working with concepts like tool use, memory, planning, and orchestration to solve complex business problems.
- What are the primary programming languages and technical skills required for the Principal Software Developer position at Oracle?
- The primary programming languages for this role are Python and Java. Essential technical skills include strong software engineering fundamentals in distributed systems, concurrency, APIs, data structures, algorithms, testing, debugging, production operations, cloud-native systems, and experience with containerized applications and Kubernetes.
- Does Oracle offer opportunities for career growth within AI and Machine Learning roles?
- Yes, Oracle emphasizes career growth and development. As a Principal Software Developer, you'll have opportunities to drive architectural decisions, mentor other engineers, and raise engineering standards, contributing to your career advancement within the AI and Machine Learning field at Oracle.
- What kind of projects can I expect to work on as a Principal Software Developer in Agentic AI at Oracle?
- As a Principal Software Developer in Agentic AI at Oracle, you can expect to work on projects involving the architecture, development, and operation of production-grade AI systems. This includes building agentic AI systems for healthcare, implementing scalable RAG and search systems, and developing LLM-powered applications.
- How does Oracle approach AI development and its impact on the healthcare industry?
- Oracle is integrating AI across its products and services to drive industry innovations, including in healthcare. This role contributes to that mission by developing AI systems that can solve complex business problems, aiming to create a better future for all through AI-powered solutions in healthcare.
- What is the expected level of experience for a Principal Software Developer at Oracle?
- Oracle typically expects at least 8 years of professional experience in software engineering, machine learning engineering, applied machine learning, or related fields for a Principal Software Developer role. A BS/MS/PhD in a relevant technical field is also standard, along with a proven track record in building and operating AI systems at scale.