He praised the new law but noted that juvenile offenders – who may try to bully classmates by creating such images – often aren’t prosecuted criminally the first time they are caught. GAINESVILLE – A sweeping new law in Florida that took effect Wednesday makes it illegal to produce sexual images of a person using artificial intelligence or similar technologies without their permission. To prevent the Grok misuse, xAI sued the user allegedly responsible for prompting Grok to generate the illegal content, but the question remains whether xAI is liable for the outputs. In a May preprint paper, researchers identified 420 apps touted as generic face-swapping tools and tested 155 to see if they could be used to sexualize images.
Victims report severe psychological harm, with 41% of cases involving minors according to a 2024 Thorn Foundation report Thorn Research. As we examine the ethical concerns below, contrast these with platforms prioritizing responsible innovation. Researchers and lawyers WIRED spoke to emphasize that these questions have not been answered in practice in the United States legal system. It might not say that encryption is illegal, but designing apps to prevent exposure to various harms could be interpreted to mean monitoring all private messages, which would of course mean the end of encrypted messaging features.
Artificial intelligence systems known as *nudify AI* are engineered to digitally strip individuals of their clothing in photos, frequently producing explicit or semi-explicit versions. Such applications have the capability to distort harmless images into harmful, explicit material that persists online long after sharing. Proactive education stands as the most effective measure to shield teenagers from encountering this problem entirely. For parents, caregivers, or survivors navigating the spread of AI-generated explicit imagery, this tool proves indispensable.
Together, these apps have more than 700 million downloads and brought in $117 million in revenue, based on data from AppMagic. Some apps later returned after developers submitted updated versions. After the group and CNBC contacted Apple, the company said it removed 28 apps and warned other developers.
What about adults?
Best AI nudify tools in 2026 compared. Uploaded photos deleted within 30 seconds, end-to-end encryption, zero data sharing. It constitutes child sexual abuse material (CSAM) under the laws of virtually every country. Similar state laws also allow victims to sue in state courts, if they so choose.
The use of AI to create sexually explicit images of people without their consent has been a growing concern amid the proliferation of platforms capable of creating photo-realistic material at the click of a mouse. “While this move won’t eliminate the problem of abusive technology in one fell swoop, alongside existing laws and our world-leading online safety reforms, it will make a real difference in protecting Australians,” she added. The researcher contacted the company about what he had found.
According to NSFW AI news and reviews Light et al., researchers can utilize this examination to discern the intended functionality of the platform in question. Specifically, the study tracks user sign-up procedures through detailed observational notes and analyzes the initial interactions encountered. Our research employs this approach to conduct a thorough examination of AI-based nudification platforms.
‘Vexatious’ Litigant Will Need Federal Court’s OK Before Any New California Privacy Claims
He cited reports of increased extortion schemes and mental health crises among victims. The ease with which such “image manipulation” may be carried out without the knowledge of its victims is alarming. Deepfake detection company Sensity recently published research into Telegram. The first step to ensure your child’s online safety is getting the right guidance. This briefing explores where children with additional needs spend their time, the benefits and drawbacks of that time, and how they can be best supported.
Big tech must deal with scam ads under Ofcom proposals
And in two of these websites, they could not register an account until after purchase (which the researchers did not do). Our researchers were able to observe and traverse much of the web pages before being required to register for an account. This focus aligns with findings from prior work on non-AI facilitated IBSA, which found that over 90% of content on “revenge porn websites” was of people who based on visual presentation appeared to the researchers to be women . We use the term “women” to describe those depicted on the websites we analyze who appear to the researchers to present as women based on their dress or anatomy (visible breasts, vulva).
The primary victims of these AI-powered nudify apps are teens, particularly those who post innocent photos on social media without realizing the risks. These apps often claim to have safeguards, such as preventing the processing of minors’ photos. AI-powered nudify apps are websites or mobile applications that use artificial intelligence to alter photos, often to create nude or explicit images. AI-powered nudify apps and deepfake technology have created a dangerous environment for teens, especially when they unknowingly become victims of these malicious practices. A newer, more insidious form of harassment has emerged, powered by artificial intelligence (AI). Thank you for taking time to provide your feedback to the editors.
Child sexual abuse material (CSAM) legislation applies to all images—whether produced traditionally or via AI—without distinction. The production and dissemination of this content are criminal offenses, with severe penalties awaiting those involved. Despite their synthetic nature, these images are legally classified as CSAM under current regulations.
Minister for Communications, Anika Wells, said the government will work closely with industry to figure out the best way to proactively restrict access to nudify tools. Developing, hosting and promoting the use of these tools for creating either adult or child content is not currently illegal in Australia. It’s a criminal offence not only to share child sexual abuse material (including fictional, cartoon or fake images generated using AI), but also to create, access, possess and solicit this material. In a July 2025 study, 85 nudify websites had a combined average of 18.5 million visitors for the preceding six months. In the first half of 2024, 16 nudify websites that were named in a lawsuit issued by the San Francisco City Attorney David Chiu were visited more than 200 million times.
Under Australian state and territory laws, an “intimate image” of an adult is defined broadly to include digitally altered or manipulated images. This includes fictional or fake images, including drawings, cartoons or images generated using AI. This can include blocking access to nudify and deepfake sites, although VPNs can bypass blocked sites.
Over the years, platforms labeled as “nudify” tools have proliferated, enabling the creation of nonconsensual and abusive explicit images of women and minors, including CSAM. Despite claims that these sites demand victim consent, Chiu’s research confirms such policies are routinely disregarded. Following a recent arrest, the DOJ officially classified AI-generated CSAM as still falling under CSAM definitions, hinting at potential future enforcement actions. While both the US Department of Justice and San Francisco officials express outrage, accountability for creators and distributors of harmful AI outputs remains scarce. Chiu’s lawsuit aims to not only block companies allegedly assisting in deepfake production and distribution but also to expose anonymous platform operators—currently operating “in plain sight”—as one site’s advertisement suggests: *”Imagine investing time on dates when you can simply generate fake nudes using a deepfake service.”*