
Staff Statistics Engineer - Feature Flagging and Experimentation
Datadog · New York, NY
- On site
- Full-time
- $267,000 / year
- New York, NY
Email the hiring manager to get a response.
Get their verified email + an intro that's ready to send.
Subject: Interested in the Staff Statistics Engineer - Feature Flagging and Experimentation role at Datadog
Hi Taylor — I came across the Staff Statistics Engineer - Feature Flagging and Experimentation opening and wanted to reach out directly. I've spent the last few years doing exactly this kind of work, and Datadog stood out because…
✎ Personalized to your résumé after sign-up.
- ✓ Verified email of the hiring manager
- ✓ Intro email personalized to your résumé
- ✓ $9/mo = unlimited — any job link
Secure checkout · cancel anytime
Job highlights
- Build Datadog's new Feature Flags and Experiments products.
- Develop a world-class experimentation engine.
- Implement advanced statistical methods in production.
- Collaborate with senior leaders on product vision.
- Utilize AI tools for coding and problem-solving.
About the role
The Opportunity
We are looking for a Stats Engineering leader to help us build two new Datadog products from scratch - Feature Flags and Experiments.
Our goal with these products is to help developers and product teams ship features quickly, experiment as second-nature, and make decisions with confidence. To do this, we need to build a world-class experimentation engine, backed by state-of-the-art statistical methods like sequential analysis, CUPED, and change point detection, which help to solve the big problems in the experimentation world of early peeking, long experiment durations, and catching bugs respectively.
Because there is often a technical, cultural, and linguistic gap between software engineers and statisticians, our Stats Engineers are unique in that they don't squarely fall into data science or software engineering. Data scientists typically understand the concepts, but may struggle to implement them in production with enterprise grade quality. Software engineers know how to build robust production systems, but can get lost implementing methods that don't have off the shelf frameworks. Here, we need the rare breed of builder who understands statistical concepts and can implement them in production.
Our experimentation platform will be used for root-cause analysis and decision-making across our 30,000+ customers of all shapes, sizes, and industries; we’ll help customers run everything from e-commerce-focused A/B tests on user adoption to infrastructure-based canary deployments in real-time to root cause major incidents, and connect the dots together across the worlds of the product manager, data person, and developer.
This is a rare opportunity to work with senior leaders across engineering, product, and design to define the foundational components of Datadog’s Product Analytics and APM stack from the ground up, and develop an experimentation engine in an AI-first world.
At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.
What You’ll Do:
- Architect and implement the world-class experimentation engine behind Datadog Experiments, supporting methods like sequential testing, CUPED, variance reduction, and more
- Bring rigor to experiment analysis at scale (e.g. through diagnostics, guardrails for safe shipping)
- Translate complex statistical methods into robust, production-ready systems
- Work closely with Product, Design, and Engineering leadership to influence the direction of the product, on both a day-to-day and the big picture vision
- Educate engineers, leaders at Datadog, and our largest customers on statistical best practices, experiment design, and practical inference
- Help define standards and frameworks to make experimentation at Datadog trustworthy by default and fast by design
Who You Are:
- You hold a PhD or equivalent experience in Statistics, Computer Science, Econometrics, or a related field. You have deep expertise in statistics, causal inference, or experimentation methods.
- You have a track record of shipping production-grade software that solves real user problems
- You understand the tradeoffs between statistical elegance and engineering complexity, and you know how to strategically make bets
- You have strong software engineering fundamentals and can write clean, maintainable code
- You can lead cross-functionally – with Engineering, Product, Design, and business teams.
- You’re excited about leveraging AI tools to enhance how you code, solve problems, and build – or eager to learn how.
- Bonus: You’ve built or worked on experimentation platforms at scale.
- You have demonstrated ability to use AI coding tools in day-to-day workflows and validate, critique, and refine AI-generated output.
- Bonus: you’re motivated to push the boundaries of how AI can improve software engineering best practices and contribute to building AI-enabled products.
Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply.
Benefits and Growth:
- Build tools for engineers like yourself – we use our own products everyday to make decisions
- Influence the experimentation and AI-centric roadmap for Product Analytics, a budding, new sector for Datadog
- Work with kind and knowledgeable teammates who are at the top of their craft and happy to collaborate, teach, and learn
- Competitive global benefits
- Continuous professional development
Benefits and Growth listed above may vary based on the country of your employment and the nature of your employment with Datadog.
Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.
The reasonably estimated yearly salary for this role at Datadog is:
$234,000—$300,000 USD
About Datadog:
Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.
Equal Opportunity at Datadog:
Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.
Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of an application.
Privacy and AI Guidelines:
Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.
Key skills/competency
- Staff Statistics Engineer
- Feature Flagging
- Experimentation
- Sequential Analysis
- CUPED
- Change Point Detection
- Causal Inference
- Production Systems
- Software Engineering
- AI Tools
Skills & topics
- Staff Statistics Engineer
- Statistics
- Experimentation
- Feature Flagging
- Causal Inference
- Sequential Analysis
- Production Software
- Software Engineering
- AI
- Datadog
How to get hired
- Tailor your resume: Highlight PhD/equivalent experience, statistical expertise, and production software shipping. Emphasize cross-functional leadership and AI tool proficiency.
- Showcase impact: Quantify achievements in previous roles, especially in building scalable experimentation platforms. Use Datadog's platform as an example of your technical understanding.
- Prepare for technical interviews: Expect deep dives into statistical methods, causal inference, and production system design. Be ready to discuss trade-offs and write production-quality code.
- Demonstrate AI aptitude: Be prepared to discuss your experience or eagerness to leverage AI tools in software development and problem-solving.
- Understand Datadog's culture: Research their hybrid work model, focus on collaboration, and AI-first approach. Align your communication style with their values.
Technical preparation
Behavioral questions
Frequently asked questions
- What is the expected salary range for a Staff Statistics Engineer at Datadog?
- The estimated yearly salary for a Staff Statistics Engineer at Datadog ranges from $234,000 to $300,000 USD. This range is based on factors such as the candidate's skills, qualifications, and experience, and may include additional compensation like equity and variable pay.
- What specific statistical methods are crucial for this Staff Statistics Engineer role at Datadog?
- Key statistical methods include sequential analysis, CUPED, change point detection, and variance reduction. Expertise in causal inference and general experimentation methods is also vital for developing Datadog's experimentation engine.
- How does Datadog balance statistical expertise with software engineering for Stats Engineers?
- Datadog seeks a unique blend of statistical understanding and production-level software engineering skills. Stats Engineers here are expected to implement complex statistical concepts into robust, scalable, and high-quality production systems, bridging the gap between data science and engineering.
- What is Datadog's stance on AI integration for this Staff Statistics Engineer position?
- Datadog is enthusiastic about leveraging AI tools to enhance coding, problem-solving, and product development. Candidates are encouraged to have experience with or be eager to learn and apply AI tools in their day-to-day workflows and contribute to AI-enabled products.
- What does Datadog's hybrid work model entail for a Staff Statistics Engineer?
- Datadog operates on a hybrid workplace model. This approach aims to provide Datadogs with work-life harmony, allowing for flexibility while fostering the collaboration and creativity that comes from in-office interaction.
- Can a candidate with strong statistical knowledge but less production experience still apply for the Staff Statistics Engineer role?
- Yes, Datadog values passion for technology and a desire to grow skills. While a track record of shipping production-grade software is preferred, they encourage applications from individuals who are eager to develop their skills in this area.
- What are the primary responsibilities of a Staff Statistics Engineer at Datadog in this new product initiative?
- The primary responsibilities include architecting and implementing the experimentation engine, bringing rigor to experiment analysis, translating statistical methods into production systems, influencing product direction, and educating stakeholders on statistical best practices.
Similar roles
Open positions we recommend based on this role.
