It’s hard to shock Collin Williams, a volunteer moderator for r/RoastMe, a comedic insult forum with 2.3 million members. But about a year ago, he was surprised by something in his own comment history. The ghosts of posts he had attempted to remove were still there. Per 2020 numbers, visit Reddit’s site each day and peruse some . Those communities are kept on-topic (and in theory, consistent with Reddit’s content policies), mostly thanks to human volunteers and automated bots, collectively referred to as moderators or “mods.” 52 million people three million topic-specific forums, or subreddits As a moderator, Williams tends to a garden of posts and comments, a process that includes removing posts that break subreddit rules. Moderators set their own rules for what is postable in their own forums, but also play a role in enforcing Reddit’s content policy. On r/RoastMe, those moderator-created rules outlaw posting pictures of someone without their permission or of people under 18, for instance. But even after Williams removed offending posts from his subreddit, they were, somehow, still viewable in his account’s comment history. The moderator’s entire history becomes this giant list … of everything they’ve removed and for what reason. r/RoastMe moderator Collin Williams Then, Williams had an epiphany. This probably wasn’t a problem just on his subreddit. Williams was right. Across Reddit, when a moderator removes a post, the post is unlisted from the subreddit’s main feed. But images or links within that post don’t actually disappear. Posts removed by moderators are still readily available to anyone on Reddit in the comment history of the moderator who flagged it—complete with an explanation of the rule it violates—or to anyone who retained a direct URL to the post. “The moderator’s entire history becomes this giant list—basically an index—of everything that they’ve removed and for what reason. Reddit kind of accidentally created this giant index of stuff that humans have flagged as being inappropriate on the site,” Williams said. This is happening across subreddits. You can still find moderator-removed or (a major Reddit faux pas) of dog photos. But it also happens on subreddits dedicated to posting sexual or sexualized content. In those cases, this loophole allows posts to persist on the site, even though they violate Reddit’s . video game memes reposts content policy Credit:Reddit.com For example, the subreddit-specific rules of r/TikTokThots, a subreddit dedicated to sexualized TikTok videos, explicitly instruct users not to post videos of people presumed to be under 18, in keeping with the Reddit-wide content policy against “the posting of sexual or suggestive content involving minors.” But The Markup was still able to find removed posts in moderators’ comment histories in which certain images, flagged by moderators for depicting presumed minors, were still live and visible. In the more risqué subreddit r/TikTokNSFW, moderators removed at least one nude image because it “contains minors,” according to moderator judgment, yet the image is still visible on the site through the removing moderator’s comment history. This is thus far a huge miss by the engineering and UX team…. Sameer Hinduja, Cyberbullying Research Center “This is thus far a huge miss by the engineering and UX team and must be rectified immediately in order to prevent new or recurrent victimization of those featured in the content,” said Sameer Hinduja, co-director of the and a professor of criminology at Florida Atlantic University. Cyberbullying Research Center Williams privately reached out to Reddit’s r/ModSupport, a point of contact between Reddit administrators (i.e., employees) and volunteer moderators, on Sept. 15, alerting them to this issue. He later received a DM from a Reddit administrator saying, “Thanks for sending this in. We’ll take a look!” But as of publication time, there had been no change. About one month later, Williams also posted publicly in Reddit’s r/ModSupport to alert other moderators to the potential problem. Reddit’s Community Team . removed his post Credit:Reddit.com Reddit has not responded to multiple requests for comment for this story. Grappling With Content Removal Reddit has continually grappled with how to police its endless list of online communities. This has played out most publicly in Reddit’s NSFW (not safe for work) content, particularly nude or sexualized images. Before 2012, explicitly banning content that sexualized minors, but the company did report “clear cut cases” of child sexual abuse material (CSAM) to the National Center for Missing and Exploited Children. Reddit did not have a publicly posted policy When it came to what Reddit termed “legally grey” areas surrounding CSAM, Reddit initially dealt with them on a But eventually, Reddit took more sweeping action to curb CSAM on its platform. “case by case basis.” For example, Reddit administrators the controversial community r/jailbait after a nude picture of a 14-year-old girl was posted on the subreddit. banned By 2012, Reddit had reformed its content policy: that focused on the sexualization of children were banned. But in 2014, The Washington Post suggested , with “every kind of filth and depravity you can conceive of—and probably quite a bit that you can’t” still live on the site. All subreddits little had substantively changed Reddit’s bans any sexual or suggestive content involving minors or anyone who even appears to be under 18. Users and moderators can report images sexualizing minors to Reddit administrators, who will remove the posts themselves and then report blatant CSAM to the National Center for Missing and Exploited Children. current policy However, Reddit is currently facing related to alleged lax enforcement of CSAM policy. In a complaint filed in April 2021 in the U.S. District Court for the Central District of California, one woman accused the company of allowing an ex-boyfriend to repeatedly post nude videos and images of her as a teenager. a class-action lawsuit “Reddit claims it is combating child pornography by banning certain subreddits, but only after they gain enough popularity to garner media attention,” the complaint reads. Reddit filed a motion to dismiss this case, citing of the Communications Decency Act, from content posted by third parties. A in October, and the plaintiff has since to the U.S. Court of Appeals for the Ninth Circuit. Section 230 which protects websites against liability court granted that motion appealed While Reddit has banned communities that violate its rules, the architecture of Reddit’s site itself allows content deemed by to violate Reddit’s policies to persist in a moderator’s comment history. Hinduja said this loophole can present problems for people struggling to remove sensitive content from Reddit’s platform. moderators “It clearly is problematic that sexual content or personally identifiable information which violates their policies (and in the history, clear explanation is typically provided as to why the material transgresses their platform rules) still is available to see,” he said. There are some cases in which removed posts don’t have accessible images. If users delete their own content (if prompted by a moderator, or of their own volition), the images seem to truly disappear from the site, including any comment history. If a user doesn’t take this action, there’s not much moderators can do to truly delete content that breaks Reddit’s rules, other than report it to Reddit. Reddit’s acknowledges that moderators can remove posts from subreddits, but don’t have the power to truly delete posts from Reddit. Moderators, to some extent, are . guidelines for moderators aware of this fact [The best a moderator can do is] click the report button and hope the overlords notice it. u/LeThisLeThatLeNO, Reddit moderator A moderator for six Reddit communities, u/manawesome326, told The Markup that removing posts as a moderator can prevent posts from showing up in subreddit feeds, but it “leaves the shell of the post accessible from the post’s URL,” which makes it accessible via moderator histories. Moderators of more risqué subreddits are also aware that they can’t truly remove content. A moderator for r/TikTokNSFW, u/LeThisLeThatLeNO, also noted to The Markup that removed posts on Reddit are still viewable and that the best a moderator can do is to “click the report button and hope the overlords notice it.” “In my experience (over 1 year ago) making reports almost always led to nothing, unless a whole avalanche of reports go in,” the moderator said via Reddit. Reddit has previously attempted to limit who can view removed content. In a , a subreddit dedicated to platform updates, Reddit administrators wrote, “Stumbling across removed and deleted posts that still have titles, comments, or links visible can be a confusing and negative experience for users, particularly people who are new to Reddit.” post in r/changelog The platform noted it would allow only moderators, original posters, or Reddit administrators to view posts that had been removed that would have previously been accessible from a direct URL. The limits applied only to posts with fewer than two upvotes or comments. Many moderators, though, had major issues with this change, because subreddits often referred to removed content in conversations and moderators have found it useful to view accounts’ past posts (even user-deleted ones) to investigate patterns of bad behavior. The trial was . Reddit did not respond to questions asking for specifics on why the trial had been discontinued. discontinued in late June Meanwhile, Williams has tried to block the route most Redditors might use to find deleted posts: his comment history. He has started to privately message users who post rule-breaking content on his subreddit to explain why it was removed rather than leaving a public comment. This method, he hopes, will make removed posts harder to find. If anyone had happened to squirrel away a direct link to a removed post, however, the offending images are still accessible. Moderation Versus “Platform Cleanliness” Although Reddit does have the power to truly delete posts, it’s still the volunteer moderators, real and automated, who do the bulk of content management on Reddit. (Posts removed by bots also still contain visible images if viewed through the bot’s comment history.) According to Reddit’s , Reddit administrators removed 2 percent of all content added to the site in 2020, whereas moderators, including bots, removed 4 percent of content. 2020 transparency report Loopholes like this one create a gray area when it comes to content moderation, said , the chair in New Media and Digital Culture at the University of Amsterdam. Richard Rogers While moderators are a first line of defense responsible for keeping prohibited content off of their subreddits, this loophole means they have little power to enforce what Rogers calls “platform cleanliness.” “Then the responsibility shifts from the individual subreddit and the moderators to the platform,” Rogers said to The Markup. “So seemingly, here, we have a disconnect between those two levels of content moderation.” In the meantime, images in removed posts will continue to linger in Reddit’s corners, just a click away from being discovered. Written by: Emma Betuel Photo by on Marco Bianchetti Unsplash Also published here

Twitter

How Rampant is COVID in Amazon Warehouses?

U.S. Federal Study Shows That Police Surveillance Oversight is Outdated

Every dollar you donate helps support The Markup’s work.

Why Are Removed Posts Still Visible on Reddit?

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

A Conversation with Kashmir Hill: Envisioning a Chaotic Future

The Noonification: Best Examples of Apps Written in React.js (9/10/2023)

Building an AI-Powered Content Moderation System with JavaScript: A Quick Guide

Elon Musk - "Free Speech Absolutist"

How Consistent ECommerce User-generated Images Help Product Managers Increase Revenue by up to 20%

How Generative AI can Help Companies Tap into the Potential of UGC

A Conversation with Kashmir Hill: Envisioning a Chaotic Future

The Noonification: Best Examples of Apps Written in React.js (9/10/2023)

Building an AI-Powered Content Moderation System with JavaScript: A Quick Guide

Elon Musk - "Free Speech Absolutist"

How Consistent ECommerce User-generated Images Help Product Managers Increase Revenue by up to 20%

How Generative AI can Help Companies Tap into the Potential of UGC

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps