TikTok has deleted 20 accounts following a BBC inquiry that uncovered a concerning trend of artificially created black female avatars being used to direct users to sexually explicit content. The social media platform took action after the BBC and researchers from the independent AI publication Riddance discovered numerous accounts across Instagram and TikTok displaying overtly sexual digital characters with exaggerated proportions and darkened skin. The accounts, which were unlabelled as artificially created in clear violation of platform policies, used racist tropes in their naming conventions and promotional language. Whilst TikTok has responded quickly, Meta, Instagram’s parent company, said it was looking into but has failed to confirm taking similar action against the accounts operating on its platform.
The Finding: Hundreds of Misleading Profiles
The BBC’s investigation, carried out alongside Riddance researchers Jeremy Carrasco and Angel Nulani, revealed a complex scheme spanning multiple platforms. The team identified 60 accounts primarily on Instagram that included links directing pointing users toward commercial adult content on third-party websites. Notably, whilst these third-party sites described the images as AI-generated, the Instagram accounts in turn offered no comparable clarification, establishing intentional misleading for unsuspecting users. The research revealed an even larger ecosystem of comparable profiles across both Instagram and TikTok that failed to direct users to paid content, indicating the problem stretches considerably further than profit-driven abuse.
The accounts utilised a systematic method to avoid identification and grow audiences at pace. Most accounts were concentrated on Instagram, with around one in three also maintaining versions on TikTok. Account names deliberately invoked racially charged language, featuring words like “black”, “noir”, “dark” and “ebony”, paired with content advancing stereotypical depictions and sexualisation. Numerous accounts maintained connections to one another, creating an interconnected network that amplified their reach and visibility. This coordinated approach suggests organised activity rather than isolated incidents, highlighting critical issues about the extent and complexity of the operation.
- AI avatars showed distorted physical proportions and darkened skin tones
- Account names used racial terminology and stereotypical language about white men
- Videos lacked labels as AI-created, violating platform guidelines
- Many accounts were interconnected, establishing interconnected networks for amplification
Abuse Via Synthetic Generation
Illicit Content and Technological Distortion
The inquiry uncovered a especially concerning dimension to the enterprise: the systematic appropriation of creative work from genuine creators. One profile that gathered three million subscribers within weeks after its launch in December had deliberately repurposed footage from genuine individuals, most notably Malaysian model Riya Ulan. The offenders superimposed the AI-generated avatar’s face—featuring an darkened skin tone—onto Riya’s form, carefully copying her actions, attire and background elements. This flagrant act of digital identity theft compounded the original exploitation, transforming genuine creative work into content for deceptive accounts.
Riya’s involvement illustrated the breach of privacy fundamental to such practices. Upon discovering her content had been stolen and redistributed, she expressed her distress to the BBC: “I was frustrated. Of course my videos are everywhere online… It doesn’t mean that you can simply steal it and repurpose it and share it as your own.” Her frustration exposes a significant shortfall in platform protections, where content makers need sufficient defences against their images being stolen for deceptive pages. The situation shows how AI technology can amplify present dangers, permitting fraudsters to scale their exploitation across numerous creators in parallel.
The misuse extended beyond basic content piracy. Accounts intentionally created fake identities with exaggerated bodily features and artificially manipulated skin tones to generate compelling, striking visuals crafted to generate user participation. These synthetic entities were presented as genuine content creators, featuring fabricated backstories and personal narratives, at the same time reinforcing damaging ethnic prejudices and objectifying narratives. The intricacy of the manipulation resulted in many individuals consumed the posts believing they were connected to actual persons, not automated creations engineered to direct users to exploitative paid content.
- Avatar’s face superimposed over stolen videos from legitimate creators
- Digitally darkened skin tones and exaggerated features created for engagement
- Accounts positioned as authentic influencers with false backgrounds and identities
Racist Depictions and Harmful Stereotyping
The accounts discovered by the BBC and Riddance researchers showed a concerning pattern of racist abuse through their deliberate naming conventions and content. Account identifiers included terms such as “black”, “noir”, “dark” and “ebony”, whilst posts repeatedly featured race-based terminology and fetishisation commentary. Many included statements such as “loves white men” and “why I need a white guy in my life”, perpetuating harmful stereotypes and reducing Black women to objects of sexual desire. This communicative structure transformed the avatars into dehumanized depictions, perpetuating long-established racist tropes that sexualize and devalue Black femininity.
The graphic depiction intensified these language-based injuries. The avatars were consistently depicted in revealing swimwear and skimpy clothing, their bodies digitally manipulated into exaggerated proportions created to enhance interaction via sexual imagery. Complexions were synthetically deepened to produce a fabricated, almost grotesque appearance that bore little resemblance to genuine human diversity. This mix of exaggerated features, exposed clothing and artificially manipulated traits created algorithmic stereotypes that operated like contemporary racist performance, converting racist imagery into computational material optimised for widespread distribution and monetisation.
Why AI Exacerbates the Problem
Artificial intelligence technology has fundamentally transformed the scale and sophistication of racist exploitation online. Previously, such harmful content needed substantial investment and manual effort to produce; AI generation enables widespread production of racist caricatures, enabling bad actors to produce numerous realistic fake accounts at minimal cost. The technology’s capacity to generate photorealistic imagery imparts unwarranted credibility to racist tropes, making them appear credible to unsuspecting users. This technological advantage turns what was once fringe exploitation into a widespread, lucrative enterprise.
The computational nature of social media platforms intensifies these harms dramatically. AI-generated content designed to maximise engagement—particularly content that leverages racial and sexual stereotypes—spreads rapidly through recommendation systems designed to prioritise user interaction. Platforms face challenges moderating the sheer volume of AI-generated content, whilst the absence of required transparency markers means users are unable to differentiate authentic creators from computational entities. This establishes conditions where racist stereotypes spread without constraint, obscured by the veneer of technological innovation and presented as entertainment rather than exploitation.
Platform Accountability and Response
| Platform | Action Taken |
|---|---|
| TikTok | Banned 20 accounts following BBC investigation; removed AI-generated black female avatars driving users to sexually explicit content sites |
| Parent company Meta stated it was investigating but had not confirmed taking action at time of BBC publication; dozens of accounts remained operational | |
| Both platforms | Failed to implement mandatory AI disclosure labels, breaching their own guidelines requiring identification of artificially generated content |
TikTok’s rapid action in taking down 20 accounts demonstrates a rare instance of platform action, yet it underscores the reactive character of content moderation in the social media era. The suspensions took place only after sustained media scrutiny and public pressure, implying that without external investigation, these accounts would have kept functioning unchecked. Notably, TikTok’s response was confined to one platform, whilst numerous problematic accounts sustained active accounts on Instagram, where they went on gathering followers and directing traffic to harmful third-party platforms. This fragmented approach highlights the limitations of isolated platform measures to structural issues.
Meta’s statement about investigating, coupled with its inability to declare tangible measures, demonstrates the gap between corporate accountability rhetoric and actual implementation. The company’s delayed response stands in stark contrast to the pressing need to combat swiftly spreading damaging material. Both platforms have created rules mandating disclosure of artificial intelligence-created images, yet these standards stayed unimplemented across vast numbers of user accounts. This compliance gap indicates that without regulatory intervention and legal accountability, platforms will continue prioritising engagement metrics and advertising revenue over platform security and the protection of marginalised communities from systematic exploitation and racist imagery.
Wider Implications for Digital Integrity
The rapid growth of unlabelled AI-generated content on major social media platforms raises key questions about digital authenticity and user trust. As AI technology becomes increasingly sophisticated, distinguishing between genuine human creators and synthetic avatars becomes significantly harder for ordinary users. This erosion of authenticity threatens the core assumption upon which social media communities are built—the assumption that accounts represent actual individuals sharing genuine experiences. When millions of users unknowingly engage with fabricated personas created to manipulate them, the platforms’ credibility as trustworthy spaces for interaction deteriorates significantly. The absence of mandatory disclosure mechanisms deliberately misleads audiences and undermines informed consent.
Beyond individual deception, the widespread deployment of AI-generated black female avatars represents a particularly insidious exploitation of racial representation in digital spaces. These artificial characters exploit harmful stereotypes and sexualised racial imagery whilst simultaneously appropriating real creators’ content and labour. The practice normalises the commercialisation of black female identity within computational frameworks designed to maximise engagement and profit. This technological racism operates at scale, reaching millions whilst remaining largely invisible to platform enforcement teams. Without robust regulatory structures mandating transparency, authentication standards, and substantive penalties for violations, online platforms will continue facilitating systematic harm against underrepresented groups.
- AI disclosure requirements should be binding in law across all platforms globally
- Authentication systems must confirm creator authenticity prior to monetisation and follower growth
- Racial discrimination in synthetic content demands explicit prohibition and ongoing monitoring
- Platforms should establish live monitoring systems with consequences matching content severity