Policy Design Manager, User Well-being

@ Anthropic

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for users and society. Our diverse team of researchers, engineers, policy experts, and business leaders work together on building AI systems with high safety standards.

About The Role

As a Policy Design Manager, you will develop usage policies, clarify enforcement guidelines, and advise on safety interventions to mitigate risks regarding user well-being, including mental health, sycophancy, delusions, and emotional attachment. You will also educate stakeholders and update policies based on expert feedback and evolving AI capabilities.

Responsibilities

• Draft and update policies for safe AI usage.
• Design evaluation frameworks to assess model performance.
• Review flagged content and enforce policy improvements.
• Collaborate with product teams to design interventions.
• Educate internal stakeholders on safety policies and standards.

Qualifications

You should have experience as a researcher, subject matter expert, clinician, or trust & safety professional with a focus in psychology, mental health, or human-AI interaction. An advanced degree in a related field is preferred. Experience in drafting user policies and bridging technical and policy discussions is essential.

Additional Information

This role might involve exposure to explicit content including sexual, violent, or disturbing themes. Anthropic is a public benefit corporation headquartered in San Francisco, offering competitive compensation, benefits, equity donation matching, generous time-off, flexible hours, and a collaborative office environment. The position follows a location-based hybrid policy, requiring at least 25% on-site presence.

Key skills/competency

• AI Policy
• User Safety
• Mental Health
• Risk Mitigation
• Regulatory Compliance
• Interdisciplinary Collaboration
• Content Review
• Evaluation Frameworks
• Stakeholder Engagement
• Policy Drafting