Under the UK's Online Safety Act (OSA), the government has threatened Elon Musk's platform X with a potential ban due to its allowance of the Grok AI tool to generate indecent images of women and children. The media regulator Ofcom has launched an investigation into X, examining whether the platform failed to assess risks of illegal content, prevent users from viewing it, remove illegal material promptly, protect user privacy, assess risks to children, or implement effective age verification for pornography. A ban, termed "business disruption measures," could be sought by Ofcom through a court order, compelling internet service providers to block access or payment providers/advertisers to withdraw services.
While the government supports a ban if X is found in breach, Ofcom has stated that such measures are a "last resort" for "serious cases of ongoing non-compliance" and not a routine punishment. Ofcom must follow due process, as a hasty decision could lead to a judicial review by X. The regulator has other options, including forcing X to take corrective steps or imposing fines of up to £18 million or 10% of worldwide revenue. The investigation's timeline is uncertain, but Ofcom has initiated it quickly due to public and political concern. Experts suggest Ofcom could expedite measures if a breach is found and X fails to remedy it.