Staff Software Engineer, Safeguards

We require at least a Bachelor's degree in a related field or equivalent experience.

Location-based hybrid policy:

Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role.

Annual Salary:

$320,000

—

$425,000 USD

Logistics

We are looking for software engineers to help build safety and oversight mechanisms for our AI systems.

As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being.

This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models.

Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review

Build abuse detection mechanisms and infrastructure

Surface abuse patterns to our research teams to harden models at the training stage

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.