AI Red Teamer
HiddenLayer · United States
- Hybrid
- Full-time
- $150,000 / year
- United States
Job highlights
- Evaluate AI system security using red teaming.
- Identify vulnerabilities in AI models.
- Simulate adversarial attacks on AI systems.
- Provide security recommendations for AI.
- Collaborate on AI security tools.
About the role
About The Role
As an AI Red Teamer at HiddenLayer, you will play a pivotal role in the ML Threat Operations group. In this role will evaluate the security of AI systems, focusing on both predictive and generative AI models. You will identify vulnerabilities, simulate adversarial attacks, and provide actionable recommendations to improve the security of AI systems. The ideal candidate is a proactive problem solver with hands-on experience in AI security testing and a deep understanding of machine learning models and adversarial techniques.
Who We Are
HiddenLayer is a security solutions provider specializing in protecting Artificial Intelligence and agentic systems, models, and their underlying data. With a first-of-its-kind, non-invasive software approach to observing and securing AI and ML, we are helping to protect the world’s most valuable technologies. Founded in March of 2022 by experienced security and AI professionals, HiddenLayer is based in Austin, Texas, and is backed by cybersecurity investment specialist firm Ten Eleven Ventures.
Our dedication to innovation has been recognized by prestigious awards such as RSA's Innovation Sandbox Winner, CB Insights AI 100, CyberTech 100, and SC's Most Promising Early-Stage Start-up.
What You’ll Do
- Conduct end to end penetration testing on AI systems, with a focus on predictive and generative AI models.
- Develop and execute adversarial attacks (e.g., evasion, poisoning, and inference attacks) to identify weaknesses in predictive models.
- Develop and execute adversarial attacks (e.g., jailbreak, hallucination, context leakage, etc.) to identify weaknesses in generative AI models and applications built on top of them.
- Collaborate with data scientists, engineering, and research teams to design and implement novel attacks and relate them back to actionable recommendations.
- Stay current with the latest AI security research, trends, and adversarial tactics.
- Produce detailed reports outlining vulnerabilities, risks, and actionable recommendations.
- Contribute to the development of internal tools and frameworks for AI red teaming.
Who You Are
- 3+ years of experience in penetration testing, with at least 1 year focused on AI systems
- Deep understanding of attack techniques specific to machine learning and artificial intelligence systems (data poisoning, inference attacks, model injection, prompt injection, jailbreaking, etc.)
- Hands-on experience with adversarial machine learning techniques and tools (e.g., Foolbox, CleverHans, ART, Purple Llama, Garak, or proprietary solutions).
- Excellent communication skills with the ability to articulate complex concepts clearly to both technical and non-technical audiences.
- Understanding of machine learning concepts and algorithms.
- Strong problem-solving skills and the ability to think creatively to anticipate potential attack vectors.
- Proficiency in programming languages such as Python, and experience with AI frameworks like TensorFlow, PyTorch, or Keras.
WHY HIDDENLAYER?
We’re moving at (what feels like) the speed of light. HiddenLayer is a venture-backed company and recently closed a $50M funding round led by M12, Microsoft’s Venture Fund, and Moore Strategic Ventures.
Benefits
- Fully Remote: We are a completely remote global team. Though we’re distributed, we are intentional about getting the team together a couple of times a year. We offer a generous stipend for your home office setup, annual upgrades to ensure you have a comfortable workspace and a monthly stipend for internet/phone expenses.
- Comprehensive Health & Wellness Benefits: Better than your average startup healthcare benefits. With five options to choose from, we cover 90% of the healthcare premium regardless of how many people you have on your plan. We also offer vision, dental, and 401k offerings.
- Flexible Time Off: Enjoy unlimited and flexible time off for all salaried employees, in addition to 15 paid company holidays.
- Commitment to Learning and Development: We support personal growth and education through a dedicated L&D fund that can be used for training, conferences, certifications and industry events.
- Diversity, Equity, and Inclusion: We are committed to building a diverse team with individuals from various backgrounds, experiences, abilities, and perspectives, and we are proud to be an equal opportunity employer.
Key skills/competency
- AI Security Testing
- Penetration Testing
- Adversarial Machine Learning
- Generative AI Security
- Predictive AI Security
- Vulnerability Assessment
- Python Programming
- Machine Learning
- Risk Management
- Threat Intelligence
Skills & topics
- AI Red Teamer
- AI Security
- Penetration Testing
- Adversarial Machine Learning
- Generative AI
- Predictive AI
- Vulnerability Assessment
- Python
- Machine Learning
- Threat Operations
How to get hired
- Tailor your resume: Highlight AI security testing experience and Python proficiency for the AI Red Teamer role.
- Showcase expertise: Emphasize hands-on experience with adversarial ML techniques and tools like Foolbox or ART.
- Demonstrate understanding: Clearly articulate your knowledge of ML concepts and AI attack vectors in your application.
- Prepare for technical interviews: Be ready to discuss AI vulnerabilities and penetration testing strategies.
- Research HiddenLayer: Understand their mission to protect AI systems and their innovative approach.
Technical preparation
Master Python and AI frameworks (TensorFlow, PyTorch).,Practice adversarial ML tools (Foolbox, ART).,Study AI vulnerabilities and attack vectors.,Develop penetration testing methodologies for AI.
Behavioral questions
Describe a complex AI security problem you solved.,How do you stay updated on AI threats?,Explain AI risks to a non-technical audience.,How do you approach creative problem-solving for security?
Frequently asked questions
- What are the key responsibilities for an AI Red Teamer at HiddenLayer?
- As an AI Red Teamer at HiddenLayer, you'll conduct penetration tests on AI systems, develop and execute adversarial attacks against predictive and generative AI models, collaborate with internal teams to implement solutions, and produce detailed reports on vulnerabilities and recommendations. You'll also stay updated on AI security trends and contribute to internal tool development.
- What kind of AI systems will I be testing as an AI Red Teamer at HiddenLayer?
- You will focus on evaluating the security of both predictive and generative AI models. This includes applications built on top of generative AI, as well as the underlying machine learning models themselves, identifying weaknesses like data poisoning, inference attacks, prompt injection, and jailbreaking.
- What experience is required to become an AI Red Teamer at HiddenLayer?
- HiddenLayer seeks candidates with at least 3 years of penetration testing experience, including at least 1 year specifically focused on AI systems. A deep understanding of ML/AI attack techniques, hands-on experience with adversarial ML tools, proficiency in Python, and knowledge of AI frameworks like TensorFlow or PyTorch are essential.
- Is this AI Red Teamer position remote?
- Yes, this AI Red Teamer position at HiddenLayer is fully remote, allowing you to work from anywhere in the United States. The company is a global remote team and offers stipends for home office setup and internet expenses.
- What makes HiddenLayer a unique place to work for an AI Red Teamer?
- HiddenLayer is a pioneer in AI security, offering a unique opportunity to work at the forefront of protecting AI and agentic systems. They are a rapidly growing, venture-backed startup with a strong focus on innovation, recognized with several industry awards. The role offers a chance to make a significant impact in a critical and evolving field.
- How does HiddenLayer support the professional development of its AI Red Teamers?
- HiddenLayer is committed to employee growth and provides a dedicated Learning and Development fund. This fund can be used for training, attending conferences, pursuing certifications, and participating in industry events, ensuring you stay at the cutting edge of AI security.