The Careless Machine: Exposing Instagram’s Darkest Secret - Meta algorithm's disturbing content finds BBC probe

Meta Platforms Photo Illustrations. - Source: Getty
BBC probe reveals Instagram's disturbing content problem - Source: Getty

BBC Eye's latest investigation, The Careless Machine: Exposing Instagram’s Darkest Secret, is gaining attention on the internet. The investigation surrounds Meta's algorithm distributing disturbing content, including child se*ual abuse material.

Released on July 3, The Careless Machine: Exposing Instagram’s Darkest Secret focuses on how Instagram's moderation system failed to catch illegal child abuse content and why Meta did not prevent these ads from spreading. As per the description, a few of these ads show children aged around eight years old and direct users to content on Telegram.

The Careless Machine: Exposing Instagram’s Darkest Secret was led by journalist Divya Arya, in search of answers from former Meta employees and the company's India leadership. The probe has put Meta's content moderation system under question and raised concerns about user safety.

More on the story below.


How did The Careless Machine: Exposing Instagram’s Darkest Secret investigation start?

Instagram's algorithm under scrutiny in BBC probe - Source: Getty
Instagram's algorithm under scrutiny in BBC probe - Source: Getty

The Careless Machine: Exposing Instagram’s Darkest Secret investigation started with opening a new account on Instagram to learn how the platform suggested new content and recommendations. After the account followed a few pages with normal but suggestive content, the algorithm started showing more adult advertisements over time, including adult po*nography.

The algorithm reportedly evolved to paid child se*ual abuse ads that directed users to Telegram, where, at only 99 rupees, allegedly illegal content was being offered. The BBC's investigation reportedly revealed one ad that appeared to reference the sexual abuse of a child. However, Instagram noted that the ad was within its guidelines and couldn't be removed.

About twenty ads for adult pornography and around thirty linked to CSAM were identified during the investigation.


Meta's response to BBC probe

According to the BBC, Meta responded by calling child exploitation a "horrific crime," and stated that they take the issue seriously and work to keep their platforms safe. They revealed that even before being pointed out by the BBC, Meta had taken actions against a number of accounts and taken down more content following the BBC's investigation.

The BBC further reported that Meta admitted its ad review system might not catch every violation but said ads are still subject to review. Meta said it takes down ads that do not follow its policies and reports them to the relevant authorities.

According to Meta, they remove links that lead to harmful websites, develop new tools to identify predators, and share information with other platforms to help prevent abuse. Additionally, they also told the BBC that they took down over four million accounts linked to "suspicious activity" last year.

In addition to Meta's statement, BBC's YouTube video titled "Instagram running ads promoting child abuse material in India - BBC World Service Documentaries" also included a response from Telegram, where they told the BBC that they follow the rules and use both technology and human reviewers to remove CSAM from their platform. According to Telegram's statement reported by the BBC, they have taken down over 274k groups and channels connected to CSAM this year.

Former Facebook executive Brian Boland, who left the company reportedly six years ago, told the BBC that in his view, the company did not put enough importance on its users' safety, which was one of the reasons he decided to leave. He said that over time:

"The trade-off of revenue and safety, or revenue and user experience, became a more core part of the conversation."

The Careless Machine: Exposing Instagram’s Darkest Secret is available to stream on BBC platforms.


Also Read: Inside fitness influencer Connor Murphy's shocking death: What really happened in Thailand

Love movies? Try our Box Office Game and Movie Grid Game to test your film knowledge and have some fun!

Quick Links

Edited by Vatsala Chauhan