The casting couch trap
GeneratedPorn
Do you have experience with “casting couch” producers, or knowledge of how non-consensual porn spreads online? We’d love to hear from you. Contact Samantha Cole securely on the messaging app Signal at +6469261726, direct message on Twitter, or by email: samantha.cole@vice.com
A censored sample of the Czech Casting dataset.
Gigabytes of questionably-sourced images
In an email to Motherboard, GP expressed another ethical concern: that the algorithm might produce something that is recognizable as a real human—a result that would negate the whole point of his project: anonymity. "It's quite possible for the algorithm to reproduce fake people who resemble real people, but it wouldn't be a 1-to-1 replication of the data it has trained on," he said. "This presents an ethical problem I'm trying to navigate around, which is identifying the rare situations where it does replicate a person from the ~7,500 images it's learning from. It's something that plagues generative networks… It's possible and I'm not quite sure how to 100% avoid the possibility of this happening. But I really do want to avoid this. I'm not interested in deep-faking anyone, even by accident, it's a bit scummy imho!""Now somebody walks up and uses those images to create a baseline for computers to use, potentially for decades to come, to use for computer generated images?”
"It certainly should be illegal"
Collage by Seth Laupus
"Now that the abuse is present I can opt to not use that data and source data from elsewhere," GP said. "Others in the area may not care and may decide to use it anyway. It's quite difficult to screen for this data completely. Doing a google image search for 'female standing nude' gives you a bunch of Czech Casting images. Throwing on the flag '-"czech"' catches a lot of them, but some still get through the cracks.""There is no such thing as ethical use of an AI that uses database images without consent”


