

Indeed, I agree with the last part. We should tread carefully with policy here, for two main reasons:
- We still have exceptionally little evidence one way or another, which is honestly insane given the topic’s importance
- “Protect the children” narrative is commonly abused for tyrannical laws that trample otherwise unrelated freedoms. I can easily see how this narrative can transform in broader AI oversight in a way that tramples democracy and fair access to information.
I merely addressed the “why is this different” issue. You’re unlikely to even want to watch any form of CSAM unless you’re into this, i.e. unless you’re a pedophile. You don’t have to be a sadistic psychopath to enjoy wreaking havoc in GTA or beating the hell out of your opponent in Mortal Kombat.
CSAM attracts a very specific demographic, and we need to make sure we understand how AI-generated CSAM affects this demographic and whether it induces real life abusive behaviors, or maybe represses them. And yes, it is also important to understand how it affects children, how likely they are to find such materials, and how it affects their sexual development. But this part is exceptionally hard to study, because you can’t just take children and expose them to CSAM to see how it’s going.
Yes, but we don’t know if it translates the same way to CSAM. That’s why we desperately need more studies. Before then, any stance is just a wild guess.
Indeed, I use CSAM as an accepted broad term, even though, if AI was not trained on real CSAM, sexual abuse was not involved. You raise an interesting political point on why we shouldn’t.
Other than that, we need to know several things when considering legality of such options:
That’s an interesting angle to look at. So, we also need to know how normalization or criminalization of AI-generated materials affect public perception of real world CSA. Makes sense.