Lensa AI Creates NSFW Images Without Any Prompting

• The Lensa appFace-changing effects are created using machine learning and photos uploaded to by users.
• AI-generated edits have enabled some users to receive images of their nude.
• Lensa can be tricked to make nudes, but some users claim they didn’t upload any NSFW images.

The trending Lensa app — currently the top photo app in the Apple and Google Play stores — generates artistic edits based on user-uploaded reference photos, but its machine-learning technology appears to be creating unintentional nudes of its users.

“Ok so I put my hottest 20 pics into lensa instead of just the first 20 selfies I could find & it came back with a bunch of ai-generated nudes,” one user wroteTwitter. “To be precise, NONE of my photos included nudity, which is prohibited by the app!”

Many others, mostly women, agreed with this sentiment, saying that the app had automatically generated sexy or outright nude photos of their photos, despite them not including reference photos that were not safe-for-work.

You May Also Like: The Effects of Divorce on Modern Society

Lensa parent company Prisma Lab’s CEO, andrey Usoltsev was co-founder told TechCrunchThese images “cannot be produced accidentally” by the App, he stated. It could be provoked through “intentional mischief,” such as uploading nudes to the Internet. terms of service(which prohibits uploading of content that is “obscene”, pornographic, lewd, suggestive, or sexually explicit).

Though it is unclear how often the app generates nude imagery without prompting, multiple users report this was the case for them.

“Strange thing is that I didn’t submit nudes because it would be against this Lensa app’s policy, but it ended up generating nudes anyway Another user posted on Twitter.

Some users are concerned that the app could have accessed photos stored in internal storage and uploaded photos. privacy policyAllows third-party companies to use data generated by an app, such as Amazon Web Services or Google Cloud Platform.

“Lensa users, did you receive a highly sexualized avatar package?” One troubled user wroteFollow us on Twitter. “I received a topless, full frontal nudity photo in my package. I’m worried. I am concerned about whether or not the app accessed other images on the phone and the rights to that image.

Usoltsev told TechCrunch the tech being used to generate the photo edits is learning as it goes and — though it has some content moderation practices — can still be outsmarted by users or act in unpredictable ways, resulting in the output of nude edits.

“We warn users that the product is not for minors and we specify that it is not intended for them.” Usoltsev also stated that we do not use such images in our promotional materials. told TechCrunch. “To enhance Lensa’s work, we are building the NSFW filters. It will blur any images that are detected as such. It will be up to the user to decide if they want to open or save such imagery.

You May Also Like: Forza Horizon 5 is more realistic than new Gran Turismo 7, research reveals

Insider asked for comment from representatives of Prisma Laboratories, but they did not respond immediately.