Head of Trust & Safety at Character AI

Character’s mission is to empower everyone with AGI. Our vision is to enable people with our technology so that they can use Character.AI any moment of any day.

Achieving our mission will require solving ambitious technical challenges, including engineering, research, and design, and we are assembling a world-class team to do so. Our founding team includes AI pioneers from Google Brain and Meta Research whose research has led to major breakthroughs in natural language understanding and dialog applications such as Transformers and Google LaMDA.

Check out our beta to get a glimpse into the future.

We are seeking a talented and creative Trust & Safety professional to join Character as our first-ever full-time T&S hire! As the Head of Trust and Safety, you’ll manage our existing team of external moderators and build out an internal and external team as we grow. You’ll expand our moderation policies, navigating the complex content policy challenges of a platform where both humans and AIs create content. You’ll work with engineers and external vendors to improve our moderation tooling and add more automation. And you’ll help keep Character a safe, fun platform for users while promoting a team culture of creativity, hard work, kindness, and success. Among the critical tasks you’ll take on:

• Lead the day-to-day operations of the Trust & Safety team.

• Develop metrics to help us measure our progress and plan for the future.

• Build out an escalation flow that resolves issues quickly, with a focus on user satisfaction.

• Develop and iterate on content policy that appropriately balances user experience and product risk, and ensure that the team remains current on all policy changes.

• Partner with our engineering team to develop the tooling needed to enforce our rules.

• Stay abreast of products in development to ensure our moderation flows and tooling keep pace with product launches.

• Analyze Trust & Safety data for trends and vulnerabilities and provide regular updates to the leadership team, with proposed mitigation strategies.

• Deal with sensitive content and emotionally charged topics with consistency, fairness, and professionalism.

Requirements:

• Deep knowledge of user safety with a minimum of 8 years of experience building and managing Trust & Safety teams.

• Detail-oriented with executive maturity and the ability to influence and communicate within all levels of the organization.

• Past experience in scaling operations, especially globally, and partnering with engineering teams to build moderation tooling.

• Past experience implementing legal compliance obligations.

• A willingness to tackle new challenges and new responsibilities as the company grows.

• A servant leader who can work alongside their team to figure out tough problems.

• A passion for keeping users safe.

• Strong ability to communicate the value of trust and safety across the company.

You will be a good fit if:

• You are proactive and have a “get things done” mindset.

• You are willing to build departments from scratch.

• You have a passion for creating innovative AI experiences, and you’re enthusiastic to lay the groundwork for our product teams to harness the power of AI.

Character is an equal opportunity employer and does not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status. We value diversity and encourage applicants from a range of backgrounds to apply.