These companies should be criminally liable for training their models on child porn.
Yes, they certainly are, and most of the major platforms are being used for this and it’s widely known. Copilot’s prompt reviewers reported it to Microsoft, per leaked documents. Grok has been known to be in use for this basically since its inception. Meta’s LLM is used for it, and they know.
I can’t speak for Gemini, Claude, or ChatGPT, but it wouldn’t surprise me at all if they’re being used for it too.
These platforms are unregulated by anything other than civil lawsuits (though some international governments are starting to move on it), so yes, they’re going to appeal to every demographic, including the worst of the worst, in a desperate bid to one day be profitable.
There was one guy arrested for it recently, a state-level deputy AG, but that dude’s the exception. Hopefully there will be more to come.
I researched this topic recently and made a video about it.
Gork went online about 3 years ago…
Thanks, Elon!
One concerning thing is that when these AI companies are pushed to crack down on this, they’ll retrain and bias their models to only recognize traditional “pornstar” body types as ‘adult’.
This is a problem when they then get used as a mass content flagging and moderation tool — it’s not hard to imagine some adult woman taking nudes (as people do) and just because they don’t have a huge bust, getting auto flagged as having illegal material. Not to mention body types that aren’t even real, like the art made in furry communities.
It’s not like there isn’t precedent, recently Discord banned a ton of people because its scanning system started throwing false positives, and that was only corrected because it made such a stink.
But bad line go up make good line go up!
This is a problem when they then get used as a mass content flagging and moderation tool — it’s not hard to imagine some adult woman taking nudes (as people do).
The problem is with sexual abuse material not nudity on its own, there is a clear distinction between those two. It seems like this is the major problem when it comes to “crack-downs” on this.
Is there a distinction between CSAM and nudes of a minor though? I understand how just same lady’s nudes and pornography have a distinction but I don’t think the same can or should be said about children, unless I’m misunderstanding you?
Well, there was this instance of a father following doctors request for care
Yeah we will drown in flase postives, my other worry is they will spend on this auto scaning of media call it problem solved slash bugets for other things and predators move to dumb tech or really encoded shit.
Thats if there even is enouth money/compute to scan everything…
They should be made to retrain their models using only images of those palaeolithic venus figurines.
AI shouldn’t train on porn at all. Too many ethical issues.
https://tsjournal.org/index.php/jots/article/view/29
exposure to csam, through self reporting, increases the risk the viewer will seek contact with children, in case you need more arguments against csam. I’ve heard the argument that AI generated images may be a harm reduction situation. it’s not. it’s incredibly damaging to the viewer if they are seeking it out, it makes them more likely to abuse, if they are exposed to it as victims it can cause lasting damage, much of it is just remixed images of actual child abuse victims, and that revictimizes them, and causes serious damage as well. We really need to stop pretending the companies that make this software aren’t responsible for this software.
So why is this a different effect to video games and violence?
why would watching children be abused from real or stimulated sources be the same as playing a violent video game?
You’re right. A video game is far more interactive. Heck these days you can even put on a headset and really simulate the action of murdering people. Grand Theft Auto is a whole detailed simulation on muder, theft, and more. Wayyy more immersive than just plain video.
Clearly then, by your own logic and the study’s conclusion, watching simulated sources make people more likely to do the thing after all. I mean, what sick person fantasizes about murdering strangers?
Obviously we must ban the existence of violent video games or crime in society will spiral out of control.
I would argue, that in both cases it only (or at least only meaningfully) affects people who already have a leaning towards the specific issue.
This study explores a sample of 1,546 anonymous individuals
I have a study of 23023012301230123050503450 anonymous individuals, of which 78% agreed that you smell like doo doo. Yep. True story. If you disagree, you hate science. How could you do this?
I shouldn’t be this sarcastic, the journal is called " Journal of Online Trust and Safety (JOTS) " with a name like that, how could I ever be so arrogant to not believe 1546 anonymous individuals on the internet? Shame on me, really.
Agreed, studies on this topic are always what someone on the other end wants to hear. The premise is inconsistent and the conclusion doesnt hold. If this study was done about something less “taboo” it would’ve been lost and forgotten.
Seems to be run by academics
If we’re appealing to authority, then let me promise you that I too have an academic degree.
reddit moment…
you can’t just dismiss an argument because the study is small. Sure it’s small, but it’s not easy to get large data on this subject.
The concept of csam exposure influencing behaviour is highly plausible.
Aside from the other good replies you have around the subject, i’ll address something more fundamental to your argument.
you can’t just dismiss an argument because the study is small.
You absolutely can dismiss a study for being too small. In some cases you really should.
If you can’t procure and retain a meaningful sample size, then you shouldn’t be running the experiment (or more usefully, designing an experiment that works with smaller sample sizes, or one that uses a demographic where you can get adequate sample sizes).
It’s one of the reasons why participant gathering is usually done up front.
True. But over 1500 responses is a massive sample size for a survey like this.
I haven’t read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.
True. But over 1500 responses is a massive sample size for a survey like this.
Genuine question, based on what?
Like, I’m just seeing a number, I’ve no idea if it’s big or small in the context of this area of study.
I’d be interested to know why that’s considered a good result.
I haven’t read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.
Agreed, I’d assume a basic level of scientific rigour.
Maybe not dismiss, but you can think twice before giving it much credit.
The government is currently looking at making anti-semitism a zero-tolerance offence in schools, in the wake of the Bell Review, which showed that 41% of Jewish pupils had suffered anti-semitic abuse at school. These are indeed troubling numbers, but baffling as 70% of British Jewish pupils are in Jewish schools. Are nearly 20% of anti-semitic incidents really occurring in Jewish schools? Or is it a flaw in the study, which had a sample size of 92 children of which 70 responded?
If we just need to be plausible, then why bother with the time and expense of studies at all? Sure, its plausible that antisemitism is on the rise in schools, but so are exclusions to a truly troubling all-time high. Is it really wise to add greatly to that number based on the experience of 29 study respondants? That isn’t even a classroom’s worth.
Small data sets can severely distort results and need to be taken with that firmly in mind.
I agree with the plausibility of the concept, but anonymous surveys aren’t really something we should be calling a “study”. They’re barely considered evidence as they’re open to extreme errors, bias, and manipulation; especially by respondents.
The concept of csam exposure influencing behaviour is highly plausible.
The entire scientific community and publishing industry is a minefield. So is CSAM and the call for more restrictive governing of the internet.
The thing I know for sure is that there are people on this planet who have a political and a financial motive to lie and fabricate studies to justify their politics.
The thing I’m mostly skeptical on is the scientific process. Not because it can’t work, but because that entire field too, has bad incentives. “Reputation” is held up, frankly, by boomers who have trouble operating a printer, but did some important theoretical work before the internet was made public and by politics and a disinterested public that doesn’t apply scrutiny to what their “intellectual elite” is actually doing.
The internet is a KNOWN source of bad information. Those 1546 “anonymous individuals” could be one bored 4chan user, or one chinese/russian/us spy agency worker justifying the next expansion of their budget.
is highly plausible.
Is not science. It’s guesswork.
I appreciate that it is difficult to collect good information on this subject, but that’s just how it is. Tough luck. As a scientist, a proper scientist, you don’t get to publish “it’s plausible” from a source you can’t verify as fact.
Second guessing science isn’t anti-science.
wow it sounds like you hate surveys and science. sorry about that.
my comment on an internet news article was that child sexual abuse material even if generated by AI isn’t a harm reduction, as it is shown to cause harm in multiple ways. if you want to argue that being exposed to csam as a viewer isn’t harmful to the viewer or doesn’t make them feel more inclined to abuse children in real life, that’s fine, you can do that AND hate science. it’s OK, man.
I’m not trying to get you to agree surveys and science as a whole are valid.
Questioning the validity of methodologies and results is a core part of the scientific method.
“It has surveys, so it must be legit” is not.
where did I make that claim?
Thanks for your service!
It’s shit like that is why I vote for the asteroid.






