\”Advocates of generative AI, in their quest for technological advancement, have brought deepfake porn, highly realistic synthetic forgeries, into the hands of everyday users. These tools, such as ‘nudify’ apps, are now easily accessible on popular websites and social media platforms, leading to the spread of manipulated sexual images of public figures. The issue of deepfakes has seeped from the online world into the lives of real users, including young individuals, implicating both AI creators and distributors. Government leaders are attempting to tackle the problem through legislative efforts, while tech and social sectors are trying to balance user responsibility with innovation. However, combating deepfakes proves challenging due to the complexity of the issue. The Cyber Civil Rights Initiative defines sexually explicit digital forgeries as manipulated content that falsely depicts a person nude or engaged in sexual activity, with generative AI tools playing a significant role in their creation. Companies have varying approaches to addressing nonconsensual synthetic content, including direct policing, terms of service violations, or denying responsibility altogether. Some companies, like Anthropic, have strict policies against NSFW content, while others, like Apple, have reinforced anti-pornography rules. Google has implemented policy changes to reduce the spread of synthetic content on its platforms, while YouTube has strict guidelines against sexually explicit material. Microsoft also has policies in place to prevent the sharing of non-consensual intimate imagery. Overall, the fight against deepfakes is complex and ongoing, with companies and policymakers working to find effective solutions to combat this growing issue.\”
