Software Engineer LLM Systems

About NewtonX

NewtonX delivers AI-powered B2B insights to the world's most demanding clients—McKinsey, Blackstone, Microsoft, Google, KKR—who use our data to make high-stakes decisions. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek and more. We've built a reputation as the quality standard in the industry. Now we're building AI systems to make that quality infinitely scalable.

NewtonX has raised $47M in funding from VCs like Two Sigma Ventures, Third Prime, XFund and Citi Ventures.

The Role of a Software Engineer LLM Systems

In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:

• Hub: The central cockpit for B2B research. Build self-serve features that compress weeks into days: question → expert insight → follow-up, powered by RAG and adaptive workflows.
• Prime: Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.

The technical challenge involves fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research-grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high-margin products, this is where you’ll do the most important work of your career.

What We're Looking For

Required:

• You write exceptional code, fast. 3-4 years of experience shipping production code in a fast-paced environment.
• Full-stack expertise: Moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar.
• AI/ML implementation experience: Hands-on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.
• Cloud and infrastructure: Experience with AWS, Docker, and modern deployment practices.
• Quality mindset: Experience with testing, code reviews, and maintaining high code quality standards.
• Customer focus: Ability to translate user needs into technical solutions while maintaining engineering best practices.

Nice to Have:

• RAG systems, embeddings, semantic search.
• Real-time data processing or streaming architectures.
• Open-source contributions in AI/ML.

What actually matters: We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs—a side project, an open-source contribution, a blog post that shows how you think—put that at the top of your application.

Why Join NewtonX?

• Frontier technology: Work with cutting-edge AI systems, pushing the boundaries of what's possible in enterprise AI applications.
• Exceptional traction: Strong product-market fit with the world's largest investment banks, hedge funds, and consulting firms.
• World-class team: We take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft.
• High velocity: Ship features that directly impact how billion-dollar decisions are made.
• Growth opportunity: Join during a hypergrowth phase with clear paths for technical and career advancement.
• Impact: Your work will directly shape how the world's leading organizations make critical business decisions.

What We Offer

• Competitive compensation with a total compensation range of $180-220k (includes base and annual performance bonus) and equity. (Please note that salary and compensation may vary based on skills, experience, performance, and location.)
• Excellent medical, dental, and vision insurance.
• 401k match with immediate vesting.
• Generous Paid time off, holidays, and parental leave.
• A diverse, collaborative, and positive culture where we invest in and celebrate each other’s success.

Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).

Key skills/competency

• LLM Infrastructure
• AI/ML Implementation
• Full-stack Development
• React & TypeScript
• Python/Node.js Backend
• AWS & Docker
• RAG Systems
• Semantic Search
• Data Systems
• Code Quality