Is this sort of NSFW AI a troubling breach of user privacy? With the huge use of artificial intelligence in production, especially if we talk about adult content — this issue is a very hot topic. A survey from the Electronic Frontier Foundation last year found that around 30% of AI media generation (in general) had problems regarding privacy intrusion, as an unusual number of recently proposed language models still do not appear to consider taking proper precautions in doing enough harm towards personal data. It can also risk sensitive data leaking without consent, even more so when the platform collects personally identifiable information (PII), and if there are questionable or non-compliant policies for handling user content according to global privacy laws like GDPR.
This is very crucial if we focus on the policy of user consent. Although regulations like the GDPR stress that people should have more transparency and control over their personal data, a study from MIT Technology Review in 2022 found little to no confidence that these AIs could comply with such rules, as more than two-fifths of AI platforms are unable to guarantee full compliance. This non-compliance makes it a little more loose in terms of the legal side, but as far as user rights might be concerned. In other cases, the violations can result in financial penalties for companies or flip into individual law suits from victims of such offenses.
“With AI, we are summoning the demon” — a wise perspective by tech entrepreneur Elon Musk. This highlights a number of ethical dilemmas, particularly concerning the ever-growing power of AI to mimic or manipulateitizens' identities. With abominations like this coming out of the tech industry, I do worry that when trained on consumers' sex photos and videos, NSFW AI systems can create eroneous material — resembling real people who arever actually agreed to be pornified. Misused, this has the capacity to violate a person's privacy and dignity as well through likenesses:nameless or consensualuce granted.
According to a New York Times investigation in 2021, an AI-driven platform ended up creating deepfake porn with images of unauthorized celebrities which was resulting in legal consequences for the individuals. This noble example from the real world of what happens when we start using NSFW AI is just a reminder that unchecked use violates too many rights. Unfortunately, the law has not caught up in most places with these technological developments (and certainly not here) — leaving a significant regulatory hole.
Knowledge of the implications for those using or building startups on such platforms is therefore imperative. nsfw ai is of no exception, and as with any platform it would have to comply by the same laws and ethics standards in order that these arent hitheits.