• 0 Posts
  • 5 Comments
Joined 3 years ago
cake
Cake day: December 20th, 2023

help-circle
  • Violent games have been shown to reduce aggression

    Yes, but we don’t know if it translates the same way to CSAM. That’s why we desperately need more studies. Before then, any stance is just a wild guess.

    The distinction between CSAM and pedophilic content

    Indeed, I use CSAM as an accepted broad term, even though, if AI was not trained on real CSAM, sexual abuse was not involved. You raise an interesting political point on why we shouldn’t.

    Other than that, we need to know several things when considering legality of such options:

    • Is real CSAM involved in a given model training data
    • Does consumption of different forms of AI-generated content increase or decrease real world sexual abuse rates
    • Is there any distinction between hyperrealistic AI-generated content and drawing-like content in terms of real world behaviors and training data
    • How can we protect children from being exposed to such content online - and how incidents of it happening anyway affect sexual and mental development of children

    Powerful people may intentionally put equality between real-life CSA and AI-generated content

    That’s an interesting angle to look at. So, we also need to know how normalization or criminalization of AI-generated materials affect public perception of real world CSA. Makes sense.


  • Indeed, I agree with the last part. We should tread carefully with policy here, for two main reasons:

    1. We still have exceptionally little evidence one way or another, which is honestly insane given the topic’s importance
    2. “Protect the children” narrative is commonly abused for tyrannical laws that trample otherwise unrelated freedoms. I can easily see how this narrative can transform in broader AI oversight in a way that tramples democracy and fair access to information.

    I merely addressed the “why is this different” issue. You’re unlikely to even want to watch any form of CSAM unless you’re into this, i.e. unless you’re a pedophile. You don’t have to be a sadistic psychopath to enjoy wreaking havoc in GTA or beating the hell out of your opponent in Mortal Kombat.

    CSAM attracts a very specific demographic, and we need to make sure we understand how AI-generated CSAM affects this demographic and whether it induces real life abusive behaviors, or maybe represses them. And yes, it is also important to understand how it affects children, how likely they are to find such materials, and how it affects their sexual development. But this part is exceptionally hard to study, because you can’t just take children and expose them to CSAM to see how it’s going.



  • Thanks for sharing this!

    I do wonder though if it actually translates to AI-generated CSAM. People who go for the real CSAM already get to accept harm caused to real children, while AI-generated one doesn’t necessarily feed off real CSAM - or at least not all people expect it to.

    There’s also a matter of legality - stepping into the criminal side by watching/storing/distributing real CSAM may embolden people to do further criminal acts.

    Finally, AI-generated CSAM can take various shapes. Do realistic depictions affect pedophiles the same way more cartoonish depictions are? This is not obvious.

    I’m not saying your conclusion is wrong, it could be completely right, but we have criminally little data on the topic. We NEED better research ASAP, because what we have now in terms of policy is still very much vibes-based, and it shouldn’t be like that. We need to know what we’re stepping in here, and what really needs to be done.