Case Studies
The TSF Case Studies are a series of real-life examples of trust and safety examples. Each case study demonstrates how difficult it is to make trust and safety decisions and is meant for you to explore the trade-offs inherent in each decision or setup, think about the questions raised by the case study, and consider the implications and outcomes.
These case studies may be helpful as a training tool and examine past examples that may have some resonance for current challenges. TSF publishes case studies in an effort to form an ongoing repository of trust and safety examples that provide deeper insight for the broader public.
The case studies are written by TSF staff and volunteers and The Copia Institute.
Featured Case Studies
-
Takedowns on YouTube skyrocket during pandemic as AI replaces human moderators (2020)
Summary: YouTube has always faced an uphill battle when it comes to content moderation. A decade ago, the job was impossible to handle with only human moderators. According to stats […]
-
Twitter briefly restricts account of writer reporting from the West Bank (2021)
Summary: In early May 2021, writer and researcher Mariam Barghouti was reporting from the West Bank on escalating conflicts between Israeli forces and Palestinian protestors, and making frequent social media […]
All Case Studies
-
Linkedin blocks access to journalist profiles in China (2021)
Summary: A major challenge for global internet companies is figuring how to deal with different rules and regulations within different countries. This has proven especially difficult for internet companies looking […]
-
Tumblr’s approach to adult content (2013)
Summary: There are unique challenges in handling adult content on a website, whether it’s an outright ban, selectively allowed, cordoned off under content warnings, or (in some cases) actively encouraged.Tumblr’s […]
-
Snapchat disables GIPHY integration after racist “sticker” is discovered (2018)
Summary: Snapchat debuted to immediate success a decade ago, drawing in millions of users with its playful take on instant messaging that combined photos and short videos with a large […]
-
Apple faces backlash against a new CSAM detection system (2021)
Summary: Apple announced on August 5, 2021 that it would introduce three new child safety features in its upcoming iOS 15 update in the United States. These features are intended to help protect […]
-
Twitter’s self-deleting tweets feature creates new moderation problems (2020)
Summary: In its 15 years as a micro-blogging service, Twitter has given users more characters per tweet, reaction GIFs, multiple UI options, and the occasional random resorting of their timelines. […]
-
Coca Cola realizes custom bottle labels involve moderation issues (2021)
Summary: Content moderation questions can come from all sorts of unexpected places — including custom soda bottle labels. Over the years, Coca Cola has experimented with a variety of different […]
-
Bing search results erases images of ‘Tank Man’ on anniversary of Tiananmen Square crackdown (2021)
Summary: On the 32nd anniversary of the Tiananmen Square protests, internet users noticed Microsoft’s Bing search engine was producing some interesting results. Or, rather, it wasn’t producing expected search results for […]
-
Twitter removes “verified” badge in response to policy violations (2017)
Summary: Many social networks have enabled users to use a pseudonym as their identity on that network. Since users could use whatever name they wanted, they could pretend to be […]
-
Spam “Hacks” in Among Us (2020)
Summary: From August to October of 2020, as the COVID-19 pandemic had no end in sight and plenty of people were still stuck at home, on lockdown, unable to gather […]
-
YouTube deals with disturbing content disguised as videos for kids (2017)
Summary: YouTube offers an endless stream of videos that cater to the preferences of users, no matter their age and has become a go-to content provider for kids and their […]
-
BoingBoing Begins Disemvoweling The Trolls (2007)
Summary: One of the challenges for any website that allows for user content — no matter the size of the website — is how to deal with trollish behavior. There […]
-
Twitter temporarily locks account of Indian Technology Minister (2021)
Summary: In late June 2021, Twitter briefly suspended the account of Ravi Shankar Prasad, the Indian government’s Technology Minister because his content violated copyright. Although Prasad was given a copy […]