Case Studies
The TSF Case Studies are a series of real-life examples of trust and safety issues. Each case study demonstrates how difficult it is to make trust and safety decisions and discusses the trade-offs inherent in each decision or setup, prompting readers to think about the questions raised by the case study and consider the implications and outcomes.
These case studies may be helpful as a training tool as they examine past examples that resonate with current challenges. TSF publishes case studies in an effort to form an ongoing repository of trust and safety examples providing deeper insight for the broader public.
The case studies are written by TSF staff, volunteer and paid writers, and The Copia Institute.
Featured Case Studies
-
TikTok and Oracle: Public Accountability via Private Auditor
Summary: TikTok has been widely criticized for its handling of U.S. based user data. The criticism is not without merit, as evidenced by numerous data security scandals and investigations. To […]
-
Public Interest, Local Laws, and Privacy Rules in India
Summary: Rahul Gandhi, the leader of India’s main opposition party, tweeted a photo of himself with the parents of a girl allegedly raped and killed in New Delhi. Since the […]
All Case Studies
-
Facebook suspends account for showing topless aboriginal women (2016)
Summary: Facebook’s challenges of dealing with content moderation around “nudity” have been covered many times, but part of the reason the discussion comes up so often is that there are so many scenarios […]
-
Game developer deals with sexual content generated by users and its own AI (2021)
Summary: Dealing with content moderation involving user generated content from humans is already quite tricky — but those challenges can reach a different level when artificial intelligence is generating content […]
-
Facebook struggles to correctly moderate the word “hoe” (2021)
Summary: One of the many challenges with content moderation is the flexibility of language. When applying blocklists — a list of prohibited terms considered not appropriate for the platform — […]
-
Electric truck company uses copyright claims to hide criticism (2020)
Summary: There are many content moderation challenges that companies face, but complications arise when users or companies try to make use of copyright law as a tool to block criticism. […]
-
Linkedin blocks access to journalist profiles in China (2021)
Summary: A major challenge for global internet companies is figuring how to deal with different rules and regulations within different countries. This has proven especially difficult for internet companies looking […]
-
Tumblr’s approach to adult content (2013)
Summary: There are unique challenges in handling adult content on a website, whether it’s an outright ban, selectively allowed, cordoned off under content warnings, or (in some cases) actively encouraged.Tumblr’s […]
-
Snapchat disables GIPHY integration after racist “sticker” is discovered (2018)
Summary: Snapchat debuted to immediate success a decade ago, drawing in millions of users with its playful take on instant messaging that combined photos and short videos with a large […]
-
Apple faces backlash against a new CSAM detection system (2021)
Summary: Apple announced on August 5, 2021 that it would introduce three new child safety features in its upcoming iOS 15 update in the United States. These features are intended to help protect […]
-
Twitter’s self-deleting tweets feature creates new moderation problems (2020)
Summary: In its 15 years as a micro-blogging service, Twitter has given users more characters per tweet, reaction GIFs, multiple UI options, and the occasional random resorting of their timelines. […]
-
Coca Cola realizes custom bottle labels involve moderation issues (2021)
Summary: Content moderation questions can come from all sorts of unexpected places — including custom soda bottle labels. Over the years, Coca Cola has experimented with a variety of different […]
-
Bing search results erases images of ‘Tank Man’ on anniversary of Tiananmen Square crackdown (2021)
Summary: On the 32nd anniversary of the Tiananmen Square protests, internet users noticed Microsoft’s Bing search engine was producing some interesting results. Or, rather, it wasn’t producing expected search results for […]
-
Twitter removes “verified” badge in response to policy violations (2017)
Summary: Many social networks have enabled users to use a pseudonym as their identity on that network. Since users could use whatever name they wanted, they could pretend to be […]