Ofcom has initiated a formal inquiry into Elon Musk’s X platform due to the creation of sexualized deepfake images by its AI chatbot tool. The UK media regulator aims to determine if the social media service has breached its legal obligations under the Online Safety Act. Potential penalties could include fines of up to £18 million or 10% of the company’s global revenue, along with other disruptive measures like cutting off payment providers or advertising services.
Technology Secretary Liz Kendall welcomed the investigation and urged Ofcom to expedite the process. She emphasized the importance of swift action in response to the disturbing content produced by the platform’s AI tool, Grok. Ofcom had raised concerns with Musk’s X and xAI last week over the creation of inappropriate images, particularly those involving children, using the Grok chatbot.
An Ofcom spokesperson expressed deep concern over reports of illegal content, including non-consensual intimate images and child sexual abuse material, being generated and shared on X through Grok. The regulator emphasized the necessity of platforms protecting users from illegal content, especially when it poses risks to children. The investigation is being prioritized to ensure legal compliance and fair decision-making.
Recent outcry has surrounded the proliferation of offensive deepfake content on Musk’s X platform, prompting action from Business Secretary Peter Kyle. He acknowledged the need for enhanced online safety measures, particularly on platforms like X. Kyle criticized the platform for inadequately safeguarding its users and pledged to address the issue.
Deputy Prime Minister David Lammy discussed efforts to address the problematic images with US Vice President JD Vance, who expressed support for tackling the issue. However, concerns were raised when a US official suggested that the UK was considering a ban similar to those seen in Russia to prevent the sharing of inappropriate images on X.
The Internet Watch Foundation reported the discovery of criminal imagery, potentially involving children, created using Grok. The material, categorized as illegal under UK law, highlighted the dangers associated with such technology. Musk’s response included acknowledging lapses in safeguards and committing to address the issue promptly.
In response to mounting criticism, X announced that creating deepfakes through Grok would become a premium service. This decision was met with disapproval from officials, with Kendall labeling it as “monetizing abuse.” The government and regulatory bodies are actively working to address the challenges posed by the misuse of AI technology on social media platforms.