The Web Watch Basis (IWF) says its analysts have found “felony imagery” of women aged between 11 and 13 which “seems to have been created” utilizing Grok.
The AI software is owned by Elon Musk’s agency xAI. It may be accessed both by its web site and app, or by the social media platform X.
The IWF mentioned it discovered “sexualised and topless imagery of women” on a “darkish internet discussion board” wherein customers claimed they used Grok to create the imagery.
The BBC has approached X and xAI for remark.
The IWF’s Ngaire Alexander advised the BBC instruments like Grok now risked “bringing sexual AI imagery of youngsters into the mainstream”.
He mentioned the fabric can be categorised as Class C underneath UK regulation – the bottom severity of felony materials.
However he mentioned the person who uploaded it had then used a special AI software, not made by xAI, to create a Class A picture – probably the most critical class.
“We’re extraordinarily involved in regards to the ease and pace with which individuals can apparently generate photo-realistic little one sexual abuse materials (CSAM),” he mentioned.
The charity, which aims to remove child sexual abuse material from the web, operates a hotline the place suspected CSAM may be reported, and employs analysts who assess the legality and severity of that materials.
Its analysts discovered the fabric by on the darkish internet – the pictures weren’t discovered on the social media platform X.
X and xAI had been beforehand contacted by Ofcom, following experiences Grok can be utilized to make “sexualised photos of youngsters” and undress ladies.
The BBC has seen a number of examples on the social media platform X of individuals asking the chatbot to change actual photos to make ladies seem in bikinis with out their consent, in addition to placing them in sexual conditions.
The IWF mentioned it had obtained experiences of such photos on X, nevertheless these had not to this point been assessed to have met the authorized definition of CSAM.
In a earlier assertion, X mentioned: “We take motion in opposition to unlawful content material on X, together with CSAM, by eradicating it, completely suspending accounts, and dealing with native governments and regulation enforcement as crucial.
“Anybody utilizing or prompting Grok to make unlawful content material will endure the identical penalties as in the event that they add unlawful content material.”
