Children are making indecent images of other children using artificial intelligence (AI) image generators, according to a UK charity.
The UK Safer Internet Centre (UKSIC) said it had received “a small number of reports” from schools but called for action now before the problem grew.
It said children might need help to understand that what they were making was considered child abuse material.
The charity wants teachers and parents to work together.
It pointed out that, while young people might be motivated by curiosity rather than intent to cause harm, it was illegal in all circumstances under UK law to make, possess, or distribute such images, whether they are real or generated by AI.
It said children might lose control of the material and end up circulating it online, without realising there are consequences for these actions. It also warned that these images could potentially be used for blackmail.
Knowledge gap
New research conducted by classroom tech firm RM Technology, with 1,000 pupils, suggests that just under a third are using AI “to look at inappropriate things online”.
“Students using AI regularly is now commonplace,” said Tasha Gibson, online safety manager at the firm.
“In fact, their understanding of AI is more advanced than most teachers – creating a knowledge gap. This makes keeping pupils safe online and preventing misuse increasingly difficult.
“With AI set to grow in popularity, closing this knowledge gap must become a top priority.”
It also found teachers were divided over whether it should be the responsibility of parents, schools or governments to teach children about the harms caused by such material.
The UKSIC wants a collaborative approach, with schools working together with parents.
“[We] need to see steps being taken now, before schools become overwhelmed and the problem grows,” said UKSIC director David Wright.
“Young people are not always aware of the seriousness of what they are doing, yet these types of harmful behaviours should be anticipated when new technologies, like AI generators, become more accessible to the public.
“An increase in criminal content being made in schools is something we never want to see, and interventions must be made urgently to prevent this from spreading further.”
Victoria Green, CEO of the Marie Collins Foundation – a charity which helps children impacted by sexual abuse – warned of the “lifelong” damage that could be caused.
“The imagery may not have been created by children to cause harm but, once shared, this material could get into the wrong hands and end up on dedicated abuse sites.
“There is a real risk that the images could be further used by sex offenders to shame and silence victims.”
‘Declothing’ app dangers
The scope for AI to turn children into the generators of extreme content was demonstrated in September by an app which creates the impression of having removed someone’s clothing in a photo.
It was used to create fake nude images of young girls in Spain, with more than 20 girls, aged between 11 and 17, coming forward as victims.
The images had been circulating on social media without their knowledge. So far there have been no charges brought against the boys who made the pictures.
So-called “declothing” apps began emerging on social media sites in 2019, often on messaging service Telegram as automated software with AI features – also known as bots.
Initially very unsophisticated, improvements to generative AI have allowed apps – like that used in Spain – to become much more effective in creating photorealistic fake nude images.
The Spanish bot has nearly 50,000 subscribers – implying it has had that many users, who pay a fee to create pictures, typically after being able to make several for free.
The BBC asked the maker of the bot for comment but they refused to provide a response.
Javaad Malik, a cyber expert at IT security firm KnowBe4, told the BBC it was becoming harder to differentiate between real and AI-generated images, a trend that was fuelling the use of “declothing” apps.
“It’s got mass appeal unfortunately, so the trend is just going up and we’re seeing a lot of revenge porn-type activities where cultural or religious beliefs cause a lot more issues for victims,” he said.
24 comments
You actually make it appear really easy together with your presentation but I in finding this topic to be actually something that I think I’d by no means understand. It seems too complicated and very large for me. I am taking a look ahead for your subsequent publish, I?¦ll try to get the dangle of it!
This really answered my problem, thank you!
Great post. I am facing a couple of these problems.
Does your blog have a contact page? I’m having problems locating it but, I’d like to shoot you an e-mail. I’ve got some ideas for your blog you might be interested in hearing. Either way, great site and I look forward to seeing it expand over time.
It?¦s truly a great and useful piece of info. I?¦m satisfied that you just shared this useful information with us. Please keep us up to date like this. Thank you for sharing.
You are my inhalation, I possess few web logs and sometimes run out from to post .
Super-Duper blog! I am loving it!! Will be back later to read some more. I am bookmarking your feeds also.
I am always invstigating online for articles that can facilitate me. Thx!
Merely wanna comment that you have a very decent site, I enjoy the design and style it really stands out.
Lottery Defeater Software: What is it? Lottery Defeater Software is a completely automated plug-and-play lottery-winning software. The Lottery Defeater software was developed by Kenneth.
What Is Neotonics? Neotonics is a skin and gut supplement made of 500 million units of probiotics and 9 potent natural ingredients to support optimal gut function and provide healthy skin.
What Is ZenCortex? ZenCortex is a natural supplement that promotes healthy hearing and mental tranquility. It’s crafted from premium-quality natural ingredients, each selected for its ability to combat oxidative stress and enhance the function of your auditory system and overall well-being.
What Is LeanBiome? LeanBiome is a natural weight loss supplement that reverses bacterial imbalance in your gut microbiome with the help of nine science-backed lean bacteria species with Greenselect Phytosome, a caffeine-free green tea extract crafted with patented phytosome technology.
I know this if off topic but I’m looking into starting my own weblog and was wondering what all is needed to get setup? I’m assuming having a blog like yours would cost a pretty penny? I’m not very internet savvy so I’m not 100 positive. Any recommendations or advice would be greatly appreciated. Appreciate it
Wow! Thank you! I constantly needed to write on my blog something like that. Can I take a portion of your post to my site?
I’m still learning from you, while I’m trying to achieve my goals. I absolutely enjoy reading everything that is posted on your site.Keep the information coming. I loved it!
Does your site have a contact page? I’m having a tough time locating it but, I’d like to shoot you an email. I’ve got some creative ideas for your blog you might be interested in hearing. Either way, great website and I look forward to seeing it improve over time.
The following time I learn a blog, I hope that it doesnt disappoint me as a lot as this one. I mean, I know it was my option to learn, but I truly thought youd have one thing fascinating to say. All I hear is a bunch of whining about one thing that you possibly can fix in case you werent too busy looking for attention.
Thanks – Enjoyed this post, is there any way I can receive an email every time you write a new article?
great publish, very informative. I wonder why the opposite experts of this sector don’t notice this. You should proceed your writing. I’m sure, you’ve a huge readers’ base already!
I am not sure where you are getting your info, but good topic. I needs to spend some time learning much more or understanding more. Thanks for fantastic information I was looking for this info for my mission.
Great – I should certainly pronounce, impressed with your website. I had no trouble navigating through all the tabs and related info ended up being truly simple to do to access. I recently found what I hoped for before you know it at all. Quite unusual. Is likely to appreciate it for those who add forums or anything, web site theme . a tones way for your client to communicate. Nice task.
Its wonderful as your other posts : D, thankyou for putting up.
you are in reality a excellent webmaster. The site loading pace is amazing. It seems that you are doing any unique trick. Moreover, The contents are masterwork. you have performed a wonderful job in this topic!