Black Box: episode 2 – The hunt for ClothOff, the deepfake porn app

In this episode of Black Box, the focus is on Clothoff, an AI app that has been abused to create false nude images of minors, sparking outrage and a call for action across several countries, including Spain and the US. The episode starts with journalist Michael Safi describing a frantic search for the app's creators as he recounts the story of Miriam Aladib, a gynecologist whose daughter became a victim of this technology when boys at her school used the app to generate explicit images.

Safi narrates how the local community rallied for accountability as Miriam posted about her daughter's experience, prompting media attention and police investigations. Despite their efforts, the law struggled to keep pace with the technology, leading to a frustrating exploration of the legal complexities involved in prosecuting underage offenders versus the creators of harmful AI apps. The clashing perspectives of concerned parents, law enforcement, and the perpetrators are brought to light.

The investigation dives deeper as the team attempts to uncover the people behind Clothoff, eventually tracing it back to a developer named Sergei Cherimush. In a search filled with twists and red herrings, they discover traceable connections to fake companies designed to conceal the true ownership of Clothoff and discover that the creators are not entirely aware of the damage their app is causing.

The narrative emphasizes a significant societal concern regarding the escalating capabilities of AI technologies and their potential to generate imaginative and emotive content that distorts reality. Miriam's insightful commentary culminates in a call to reform laws and safeguard communities against tech-enabled harassment and exploitation. Safi ends the episode by foreshadowing a growing wave of similar incidents that are yet to unfold, highlighting the urgent need for action in addressing the legal and moral obligations surrounding AI.