Ofcom has made “pressing contact” with Elon Musk’s firm xAI following stories its AI instrument Grok can be utilized to make “sexualised photos of kids” and undress ladies.
A spokesperson for the regulator mentioned it was additionally investigating issues Grok has been producing “undressed photos” of individuals.
The BBC has seen several examples on the social media platform X of individuals asking the chatbot to change actual photos to make ladies seem in bikinis with out their consent, in addition to placing them in sexual conditions.
X has not responded to a request for remark. On Sunday, it issued a warning to users to not use Grok to generate unlawful content material together with little one sexual abuse materials.
Elon Musk also posted to say anybody who asks the AI to generate unlawful content material would “undergo the identical penalties” as in the event that they uploaded it themselves.
XAI’s personal acceptable use coverage prohibits “depicting likenesses of individuals in a pornographic method”.
However folks have been utilizing Grok to digitally undress folks with out their consent and with out notifying them.
It’s a free digital assistant – with some paid for premium options – which responds to X customers’ prompts once they tag it in a put up.
Samantha Smith, a journalist who found customers had used the AI to create photos of her in a bikini, advised the BBC’s PM programme on Friday it had left her feeling “dehumanised and lowered right into a sexual stereotype”.
“Whereas it wasn’t me that was in states of undress, it seemed like me and it felt like me and it felt as violating as if somebody had truly posted a nude or a bikini image of me,” she mentioned.
Underneath the On-line Security Act, Ofcom says it’s unlawful to create or share intimate or sexually express photos – together with “deepfakes” created with AI – of an individual with out their consent.
Tech corporations are additionally anticipated to take “acceptable steps” to cut back the dangers of UK customers encountering such content material, and take it down “shortly” when made conscious of it.
A House Workplace spokesperson mentioned it was legislating to ban nudification instruments, and beneath a brand new prison offence, anybody who provided such tech would “face a jail sentence and substantial fines”.
