Scaled Abuse Analyst, YouTube Trust and Safety

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 2 years of experience in data analytics, Trust and Safety, policy, cybersecurity, or related fields.
  

Preferred qualifications:

• Experience in content policy, anti-abuse, and reviewing online content.
  
• Experience with identifying abuse trends or working in news or policy.
  
• Experience with SQL and spreadsheets.
  
• Ability to build relationships with cross-functional partners across geographies.
  
• Excellent problem-solving skills, with the ability to use data to drive strategy and business action.
  

About the job

Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to belong, create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.

As a Scaled Abuse Analyst, you will be responsible for working with a global team from policy, enforcement, product, engineering, tooling, and legal to prevent violative content from appearing on the platform. You will evaluate abuse trends and develop creative solutions to address detection gaps, quality workflows, and processes. You will also review decisions about the appropriateness of different content. You will grow in a paced, dynamic, and demanding environment where the threat actor landscape is constantly evolving.

In this role, you will be a contributor to the efforts to reduce harmful content on YouTube. You will be part of a team that oversees emerging threats to the YouTube platform and user base. These threats include, influence operations, financially motivated abuse, sensationalist news, with a focus on deceptive practices.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun — and we do it all together.

Responsibilities

• Research and stay up-to-date on trends and suspicious patterns of abuse across the team’s policy areas. Oversee enforcement quality across team policy areas, including calibrations with vendor teams.
  
• Utilize methods to analyze data sets to gain insights into the impact of abuse on the YouTube ecosystem with knowledge of SQL and dashboarding.
  
• Leverage SQL and programming skills to provide rapid incident response for abuse problems, operating with minimal guidance. Analyze and draw conclusions on root-causes and define and implement mitigation steps.
  
• Contribute to the strategy and development of new workflows to address additional known and emerging vectors of abuse. Apply and develop machine learning models (e.g., using LLMs, BERT) to detect, prevent various types of abuse on YouTube.
  
• Develop Machine Learning (ML) based detection systems for different adversarial and large scale coordinated abuse vectors.