Data Scientist II - AI Assurance Researcher
Pacific Northwest National Laboratory · Richland, WA
- On site
- Full-time
- $148,000 / year
- Richland, WA
Job highlights
- Research AI model internals and data properties.
- Design and execute large-scale ML experiments.
- Analyze deep learning models, LLMs, and vision models.
- Publish research and collaborate with teams.
- Requires security clearance and drug testing.
About the role
About the Role
Pacific Northwest National Laboratory (PNNL) is seeking a Data Scientist II - AI Assurance Researcher to join the AI and Data Analytics Division within the National Security Directorate. This role focuses on understanding, exploring, and manipulating the internal mechanics and behaviors of AI models, providing insights into decision boundaries and mathematical fingerprints of data properties. You will work in multidisciplinary teams to connect foundational research to engineering and operations, delivering computational solutions for complex data and analytic challenges.
Key Responsibilities
- Design and execute rigorous ML experiments using best practices, including large-scale training and evaluation on HPC infrastructure.
- Evaluate AI systems across multiple dimensions: performance metrics, generalization, robustness, and out-of-distribution behavior.
- Analyze internal structures and representations of deep learning models, with emphasis on large language and vision models.
- Assess empirical results to identify trends, inform research direction, and recommend next steps.
- Write high-quality, well-documented research code for reproducibility and collaboration.
- Contribute to publications and technical reports for internal and external audiences.
- Collaborate with senior researchers, engineers, and cross-functional teams to integrate research into broader systems.
- Conduct work in secure environments adhering to operational security requirements.
Qualifications
Minimum Qualifications:
- BS/BA and 2 years of relevant experience, OR MS/MA, OR PhD.
Preferred Qualifications:
- Degree in computer science, engineering, mathematics, or a related field.
- Familiarity with current ML research, including explainable AI, adversarial machine learning, AI safety, and the science of deep learning.
- Hands-on experience analyzing internal structures of deep learning models (LLMs, LVMs).
- Proficiency in PyTorch and associated deep learning libraries.
- Experience designing and executing experiments on HPC systems.
- Experience translating research prototypes into deployable tools.
- Strong communication and collaboration skills for multi-disciplinary teams.
Security and Eligibility Requirements
- U.S. Citizenship required.
- Must obtain and maintain a federal security clearance.
- Background investigation includes review of employment, education, financial, and criminal history.
- Position is a Testing Designated Position (TDP) subject to pre-employment and random drug testing (including marijuana, which is illegal under federal law).
About PNNL
Pacific Northwest National Laboratory (PNNL) is a world-class research institution committed to Integrity, Creativity, Collaboration, Impact, and Courage. We offer an exciting research environment, excellent benefits, and a location in eastern Washington known for outdoor recreation and an affordable cost of living. PNNL is an Equal Employment Opportunity employer.
Key skills/competency
- Data Science
- AI Assurance
- Machine Learning
- Deep Learning
- Large Language Models
- Computer Vision
- HPC
- PyTorch
- Research
- Data Analysis
Skills & topics
- Data Scientist
- AI Assurance
- Machine Learning
- Deep Learning
- LLM
- Computer Vision
- HPC
- PyTorch
- Research
- Data Analysis
- NSD
- PNNL
- Computer Science
- Engineering
- Mathematics
- Explainable AI
- Adversarial Machine Learning
- AI Safety
How to get hired
- Tailor your resume: Highlight experience with AI assurance, ML experimentation, deep learning models (LLMs/LVMs), PyTorch, and HPC systems. Quantify achievements where possible.
- Showcase research skills: Emphasize experience in designing rigorous experiments, analyzing model internals, and translating research into practical tools.
- Address security requirements: Be prepared to discuss your U.S. citizenship and ability to obtain a federal security clearance, including adherence to drug-free workplace policies.
- Prepare for technical questions: Expect to discuss your understanding of AI safety, explainable AI, adversarial ML, and your experience with PyTorch and HPC environments.
- Demonstrate collaboration: Highlight your ability to work effectively in multidisciplinary teams and communicate complex findings.
Technical preparation
Master deep learning frameworks like PyTorch.,Practice designing and evaluating ML experiments.,Understand LLM/LVM internal analysis techniques.,Gain experience with HPC environments.
Behavioral questions
Describe a complex ML problem you solved.,How do you ensure research reproducibility?,How do you collaborate in a research team?,How do you translate research into tools?
Frequently asked questions
- What are the key technical skills required for the Data Scientist II - AI Assurance Researcher role at PNNL?
- The role requires strong skills in machine learning experiment design and execution, analysis of deep learning models (especially LLMs and LVMs), proficiency in PyTorch and associated libraries, and experience with High-Performance Computing (HPC) systems. Familiarity with explainable AI, adversarial machine learning, and AI safety is also highly preferred.
- Does this Data Scientist II position at PNNL require specific security clearances or background checks?
- Yes, this position requires the ability to obtain and maintain a federal security clearance. Applicants must be U.S. Citizens and will undergo a federal background investigation, including checks on employment, education, financial, and criminal history. The role is also a Testing Designated Position (TDP) subject to pre-employment and random drug testing.
- What is the expected work arrangement for the Data Scientist II - AI Assurance Researcher at PNNL?
- This position is based in either Richland, WA, or Seattle, WA, and requires an onsite presence. It is not a remote or hybrid role.
- What educational background is preferred for the Data Scientist II - AI Assurance Researcher position at PNNL?
- While a BS/BA with 2 years of experience, MS/MA, or PhD is the minimum requirement, a degree in computer science, engineering, mathematics, or a related field is preferred. Advanced degrees and specific research experience are highly valued.
- How does PNNL approach compensation for the Data Scientist II - AI Assurance Researcher role?
- PNNL lists the full pay range ($114,000 - $182,100 annually) and bases starting pay on relevant skills, qualifications, and experience. They do not consider past or current salaries, focusing instead on the position's requirements, market trends, and individual qualifications.
- What is the significance of 'AI Assurance' in this Data Scientist role at PNNL?
- AI Assurance in this context means ensuring the reliability, robustness, and trustworthiness of AI models. This involves understanding their internal workings, identifying potential vulnerabilities, evaluating their performance beyond standard metrics, and ensuring they behave predictably and safely, particularly in national security applications.
- Can foreign nationals apply for the Data Scientist II - AI Assurance Researcher position at PNNL?