Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
About The Role
BJAK is building a proactive AI system that carries work forward across conversations, tools, and time. As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience. You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.
Focus
- Build and operate backend systems that serve AI-powered features in production.
- Design inference pipelines, orchestration layers, and service boundaries around models.
- Own production concerns: monitoring, logging, alerting, and incident response.
- Optimize latency and throughput across inference, caching, batching, and streaming.
Ideal Experiences
- Strong backend engineering fundamentals in production environments.
- Experience running high-throughput, low-latency services.
- Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
- Comfortable debugging distributed systems under load.
- Bias toward shipping and learning from production behavior.
Outcomes
- Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.
- APIs are stable, clear, and support seamless integration with frontend and ML systems.
- Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.
- Iterative improvements based on real usage continuously increase system performance and reliability.
Tech Stack
- Python
- Node.js
- PyTorch
- OpenAI / Anthropic / open-source LLMs
- SQL & NoSQL
- Kubernetes
- Docker
How We Work
The best products today in the world were built by small, world-class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product.
Interview Process
If there appears to be a fit, we'll reach out to schedule 3, but no more than 4 interviews. Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite. We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.
Key Skills/Competency
- Backend Engineering
- AI Systems
- Production Systems
- Inference Pipelines
- Orchestration Layers
- High-Throughput Services
- Low-Latency Services
- Distributed Systems
- Python
- Kubernetes
How to Get Hired at BJAK
- Tailor your resume: Highlight backend engineering, AI inference, and high-throughput systems experience.
- Showcase production experience: Emphasize your ability to debug distributed systems and optimize for latency.
- Prepare for technical interviews: Be ready to discuss AI inference patterns and production system operations.
- Demonstrate initiative: Convey a bias for shipping, learning, and independent execution.
- Understand the culture: Research BJAK's focus on small, world-class teams and collective decision-making.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background