Ireland South MEP leads EU ban on AI ‘nudifier’ tools

AN IRELAND South MEP is leading the way in introducing new legislation in the European Parliament to ban artificial intelligence “nudifier tools” used to create or manipulate sexually explicit or intimate images of real people without their consent. Independent MEP Michael McNamara first proposed the ban in the European Parliament in March, arguing that existing legislation failed to address the growing misuse of generative artificial intelligence to produce realistic fake nude images. The proposal received broad cross-party support, with members of the European Parliament voting by a significant majority to adopt the new measures as part of wider reforms to the EU’s AI regulatory framework, which will in turn be implemented in Ireland. The new rules are expected to come into effect on December 2 and represent one of the most significant updates to the European Union’s Artificial Intelligence Act since it was first agreed. As part of the legislation, providers of AI systems capable of generating or manipulating sexually explicit images resembling identifiable individuals without their consent will be prohibited from placing such systems on the EU market unless they include adequate technical safeguards preventing their misuse. The prohibition will also extend to deployers who use AI systems specifically for the purpose of creating non-consensual intimate images. The legislation forms part of the European Commission’s seventh omnibus package, which introduces amendments relating to data use, data protection, artificial intelligence regulation, and proposals to establish European Business Wallets designed to simplify digital interactions for businesses operating across the EU. Following the successful vote in Parliament, Mr McNamara said he believes the legislation closes a significant loophole in existing AI laws, one that has become increasingly apparent as generative AI technology has rapidly evolved over the past two years. “Recent controversies involving AI systems demonstrated there was no clear prohibition on the technology which was being used to generate highly realistic fake nude images of real people, of which the overwhelming majority of victims were women and girls,” he said. The issue has become an increasing concern for lawmakers and law enforcement agencies across Europe, as advances in generative AI have made it possible to create convincing fake images using only publicly available photographs. Campaigners have warned that these so-called “nudifier” applications can be used to harass, intimidate, and exploit victims, causing severe emotional distress and long-lasting reputational damage despite the images being entirely fabricated. Grok investigations The European Commission has already been forced to examine the issue following several high-profile controversies involving AI-generated explicit content. In January, the Commission launched an investigation into Grok, the AI tool integrated into the social media platform X, over concerns surrounding the generation and circulation of sexually explicit images, including potential child sexual abuse material. The investigation highlighted growing concerns about the safeguards built into increasingly powerful AI systems and whether developers are doing enough to prevent their technologies from being used for harmful or illegal purposes. The impact of AI-generated imagery has also become increasingly evident closer to home in Ireland. In March, it emerged that the number of Garda investigations involving images generated using the Grok AI tool had increased from 200 to 244 in a relatively short period. At the time, the Oireachtas Committee on Artificial Intelligence heard evidence that approximately half of those Garda investigations related to suspected child sexual abuse material, underlining the serious criminal implications associated with the misuse of generative AI technology. Mr McNamara said tackling this gap in legislation became a priority after he was appointed rapporteur in the European Parliament. “I pledged to change that when I was appointed as a rapporteur in the Parliament. Following negotiations with the Council, the passing of this legislation will ensure that this abuse will no longer be allowed,” he said. Scope of the legislation Beyond banning AI nudification tools, the updated legislation also seeks to simplify aspects of the wider AI Act while providing businesses, public authorities and developers with additional time to prepare for compliance with rules governing high-risk artificial intelligence systems. “The updated rules also extend compliance deadlines for certain high-risk AI systems, giving businesses and public authorities additional time to prepare while maintaining key safeguards,” Mr McNamara added. Under the revised timetable, obligations governing stand-alone high-risk AI systems will apply from December 2027, while AI systems embedded as safety components within products covered by existing EU sectoral legislation will become subject to the rules from August 2028. The legislation applies to a broad range of AI systems considered capable of having a significant impact on people’s rights or safety. These include systems used in biometrics, critical infrastructure, education, employment, access to essential services, law enforcement, justice, and border management. However, lawmakers have stressed that the ban on AI nudification tools is carefully targeted. It will not apply to AI systems that incorporate effective technical safeguards preventing users from generating non-consensual intimate images, reflecting an effort to regulate harmful applications rather than restricting legitimate innovation. The reforms also contain several measures designed to reduce unnecessary regulatory burdens on businesses, particularly smaller companies seeking to develop AI technologies responsibly. ‘An outright ban on nudification apps’ Further amendments include allowing personal data to be processed, where strictly necessary and subject to safeguards, to identify and mitigate bias in AI systems. The legislation also streamlines enforcement responsibilities for certain general-purpose AI systems by centralising oversight within the EU’s AI Office. Mr McNamara said the overall package strikes a balance between encouraging innovation, providing certainty for businesses, and strengthening protections for individuals who may be vulnerable to the misuse of rapidly developing AI technologies. “This omnibus was about establishing legal certainty by extending certain timelines while preserving the AI Act’s architecture and strengthening protections where possible,” he said. “We agreed to a limited change on machinery products, with clear safeguards, and secured an outright ban on AI nudification apps. They impact real people, overwhelmingly women, with the purpose of humiliating, degrading, and objectifying them. “I’m proud that this Parliament fought for the ban, which will enter into force before the end of this year.” – Court Reporting Scheme The post Ireland South MEP leads EU ban on AI ‘nudifier’ tools appeared first on Limerick Post.