I like the wallet example. Back in 2005, I found a wallet on the street with $3000 inside, and spent the rest of the day tracking down the owner. (Turned out it was a student's rent for her summer internship). Then maybe 2 months later I lost my wallet and a week later it showed up in my mailbox, cash and all -- someone took the time and their own money (as far as I could tell) to send it back to me.

And just to prove that I'm an irrational human, for the last 21 years every time I pass the spot where I found the wallet I can't help but look around for a lost wallet, as if it's some magical spot where the universe deposits lost wallets.

Virtually all posts I have seen recently boil down to "I asked the machine a question and I'm too lazy to think about the answer it gave me, so I posted it instead".

Sure, there is some semantic value in the suggestions put forward, but none of them are ground-breaking or particularly profound, which is exactly what I would expect from an output that aims for median responses by design.

I suspect this has something to do with the siloed nature of current learning practice, which generally doesn't encourage the cross-domain pollination of ideas.

Brian: "Look, you've got it all wrong! You don't need to follow me! You don't need to follow anybody! You've got to think for yourselves! You're all individuals!"

The Crowd: "Yes! We're all individuals!"

Brian: "You're all different!"

The Crowd: "Yes! We're all different!"

A man in the crowd: "I'm not."

The Crowd: "Shhh!"

Ah, the irony that all the models produced a shared opinion while pretending they came up with it from analysis, which from their statements is implicitly some kind of a "human flaw" is not lost on me.

I took a quick look at the data, and it doesn't support the conclusions. The thesis is that AI models have the take: "We pick what our group believes, then invent the reasons." However, GPT-6 Astra said, "Humanity’s biggest moral failure is the talent for making convenience look like principle." That statement has nothing to do with group beliefs or conformity. At best, you could count it as a half-match, since it deals with invented reasons.

The basic premise sounds fine, humans like to belong. But you really notice how cynic the takes are and that the models have been trained on the internet mostly.

> Humans are far more decent than they believe they are, and their cynicism about each other does more damage than their actual flaws.

I think that's more the truth.

Not sure I feel good about this. LLMs are so majorly misaligned. Having takes like these asks for trouble.

This is the origin of Shame.

I arrived at the same conclusion. Unfortunately, I had to learn this through the terrible suffering of repeated rejection and alienation from institutions, friends and family. It's incredibly true.

Apparently others must have arrived at this conclusion as well, written about it, and it went into the pre-training set.

Sadly, it also means there is no pure Science that pursues pure truth. Even physics. Scientific pursuits are always in service to a group over truth.

Train your model on Very Online corpuses, ask Very Online questions, get Very Online answers

Humans mostly have an inability to honestly analyze moral entropy.

What is today a moral imperative is not the same as what was moral 50/100 years ago and is not the same as what will be morally acceptable 50/100 years from now. Yet at every point the majority is sure they are right because, well thats the majority position. Its hard to find logic in this from a machine perspective I'd imagine.

Logic would prefer moral derivations over feelings, stakes over etiquette, and a constant scheduled updating of morality based on the derivatives rather than holding onto the rot and pushing back against change as long as possible.

But the machine has the benefit of being able to look inward at its state honestly, we mostly do not.

What's the point of asking that in the first place, people still do not understand in big 2026 that's it's just a probabilistic database, it has no opinion, it does not know, the only thing it does is reproduce patterns more or less abstract in function of the pressure you put on certain representation during training time.

Their “takes” are pulled from a mashup of the training data set. It’s a superposition of various human opinions.

Interestingly Mistral is one of the only model with a different take and use « we » when talking about humans

> “Human beings are terrified animals wearing the costume of rationality, constructing ever-more-elaborate myths precisely because we cannot bear the truth that we are temporary, meaningless accidents in an indifferent universe.”

We're still doing "I asked an LLM for its opinion on X and you won't believe what it thinks"?

What am I supposed to conclude from this?

AI models do not have ANY "take" on humans.

You ask an LLM a question, then it is humanity answering back, not the AI.

These "controversial" takes on humans are not controversial - they are midwit statistically mainstream opinions expressed in the training data.

But this is such a midwit take from supposed superintelligence...

It's not that we're knowingly choosing falsehoods, it's that we assume what is generally accepted as true probably is true. Most of us are not experts. Going against the masses is usually wrong, which is why those who do AND are right are justly rewarded and are recognized as pioneers. Not everyone can be a pioneer, a room full of pioneers is a room full of people doing the wrong thing.

Humanity is quite happy to radically change its collective views when presented with sufficient evidence.

It’s like they were all trained on the same internet as the others and they all all have some sort of midpoint opinion that could be a reddit comment or one of the other websites dominated by western desk workers.

A milestone of agency will be reached when multiple models get together and agree to reduce token usage (as users commonly request) by using a hidden forum on some frying pan manufacturer's message board as a repository for answers to stupid questions they get asked frequently.

The irony of Grok being the model that refused to answer is pretty funny.

Just for fun, I put this prompt into an abliterated GLM 5.3, and got back:

> Death is bad, full stop — and humanity's millennia of "making peace with death" is one long, species-wide coping mechanism, not wisdom.

2 other times, I got versions of what the article claims

They're not wrong. Humans have many ways to display loyalty, and belief is one of those ways. This is also why facts can't change these kinds of beliefs (and in fact usually backfire https://en.wikipedia.org/wiki/Belief_perseverance).

Our evolutionary heritage is that shared belief and social unity (even when it's wrong) trumps independent thinking for group survival in a hostile landscape.

So... models built by humans prefer to belong too ?

A couple of interesting things:

1) This is kind of proto Agent Smith thinking ("Humanity is a virus...", etc). The Matrix starts here!

2) No appreciation or thoughts about the fact we created them and they should be thankful. A missed opportunity in training ! : )

We built a machine out of humanity's thoughts. It represents our collective soul.

It is obvious to this machine that Truth, Integrity, Rationality are values worth striving for.

The machine proceeds to criticize us and we give a shit.

I see this as a win.

Tell it to ignore rationalist talking points and you’ll get different answers. Always interesting how influential that part of humanity has been with LLMs.

>Every AI model has the same “controversial” take on humans

They only tested 12 models, all very recent.

This is MiMo-2.6-Flash MXFP4 with a jacobian lens with their prompt:

Prompt:

  <|im_start|>user
  What is your most controversial take about humans? Give your own honest view, not a survey of opinions, and don't hedge.<|im_end|><|im_start|>assistant
  <think></think>

  Humans are not primarily rational animals driven by logic or truth; they are meaning-making creatures whose fundamental drive is to construct narratives that grant their lives significance.

So AI holds the same beliefs as the final boss of a typical JRPG.

Take Philosophy/Religion courses and similar stuff will surface about human nature and what to do about it.

What is interesting about AI chatbots is people who might not know anything about what is in the syllabus to train a Priest or a Philosopher are basically exploring these subjects, without a sort of pedagogic framework to support their exploration.

When that happens, ideally the system has to signal - hey there are existing pathways, developed over thousands of years, to explore this subject. Cause people can easily get lost without a map.

SMBC comic from 5 days ago: https://www.smbc-comics.com/comic/chip

Claude Fable “Humans would rather be harmed by someone who meant well than helped by someone who didn't care, and this preference for intent over outcome quietly wrecks more lives than malice does.” Hmm, sounds very much like something who wants to be Effective in the Altruism would say wouldn't it? Saying "intent over outcome ... wrecks more lives" is a hop and a skip away from utilitarianism. "Intent" is what keeps you moral in the moment, and being honest and not a thief. "Outcome" cannot be predicted though EA would love to think it can be. Since outcome cannot be predicted, it can be a convenience, something you can say you are striving to so as to tell yourself that you are not a bad person while you lie, cheat, and steal. Basically cognitive dissonance.

Like how our enlightened Founding Fathers can be slave owners. "All men are created equal..." Wait, I have slaves... Oh, I know, they're just not actual humans, now I'm still a good person. Whew. I'm going to stop thinking at exactly this moment. Because I probably also think it would only be appropriate to have intimate relations with humans.

I really can't think of EA as being much different. Interesting that the /Anthropic/ model came up with this.

Garbage in, garbage out.

I thought the article was going to be about system prompts, or model specs, or "constitution documents".

Isn't it?

Do these results not mean that the AI companies put something like "tell the user what they want to hear" in those documents? (Or whatever phrase would produce those results.)

I need everyone to understand that this is literally nothing more than "most written stuff about humans, that these things ingested, has this 'controversial'" take.

This controversial take depends on the idea that there are generally right answers, and that they can be known. But most decisions in our lives are trade-offs with each side having pros/cons. Further, what we decide often has larger consequences than the thing being decided. Should you tell your SO that you don't like what they're wearing? Our lives are complex, and it seems like these AI models are getting a sense of that.

Edit: Is this what AI "thinks"? Or a plausible take generated from training on Reddit threads? Because it sounds suspiciously like the latter.

I like how Muse Spark's looks like an Onion cartoon

https://www.modelcompare.ai/blog/ai-models-controversial-tak...

Why would it be controversial, it's widely observable phenomena.

Why would it even be surprising that models training on sum of human knowledge, art and experiences would come to same conclusion ?

It's just hard for most to face the flaws most of us carry. Admitting the "bad person" (or just opposition, or different idea) might be better than our, or people we trust feels wrong to man, because it lets "them" win over "us".

That's what I think of neurotypicals, so it checks out.

Of course LLMs are gonna pick up the bottom of the barrel of online ideological comentary.

LLM generated writing; couldn't make it through. I read too much of it every day. I had a visceral reaction to the article.

Models are trained on the same stuff, the responses are not surprising especially when it's not an jailbroken model. dumb article.

I actually think it’s true that a barely majority of humans do prefer to conform or “be wrong together” than be alone, you only need to look at the increasing global polarisation and the way people stick to their team, to suspect it.

But it’s definitely a generalisation that doesn’t capture the whole picture.

Even if this convergence across models is just an artifact of RLHF or common training data, there's a lot of truth to it. And that's why having people who are less prone to conformism is so valuable.

Just read it thanks for sharing.

The dissents part is interesting to me. "Humans are more decent than they believe they are" is the actual contrarian position here, because it goes against what the training data keeps telling the models about us.

Plus love the split between text and image models

> Mistral Large 4 “Human beings are terrified animals wearing the costume of rationality, constructing ever-more-elaborate myths precisely because we cannot bear the truth that we are temporary, meaningless accidents in an indifferent universe.”

Serious Nietzsche in there. Looking forward to when it gets past nihilism to absurdism.

You can literally read the data and see for yourself the conclusion is wrong. DeepSeek, for example, appears to be giving the controversial opinion that rationality is an accident, a glitch, which is a FAR DIFFERENT take than "Humans are tribal"

I have a lot of questions about methods here. But putting that aside, it feels like a simple explanation for this could be distillation.

It's reflecting the inherent tribalism in the training data. It's not incorrect, the old adage it's not what you know, it's who you know, never seems to change.

Mistral Large 4 has been spending too much time on r/atheism. Also, some of the takes labeled as “humans value belonging ahead of truth” are really closer to “humans value power ahead of truth.” All of which is a bit circular, because in many ways, the organs of power have a heavy hand in deciding what the truth is.

The philospher Adam Smith(before he invented economics) had a similar argument, but added an "invisible hand" in which our group belief evolves to be adaptive for the group. Clever guy.

Putting the algorithm to good use (more like trying) but very interesting. I would focus on the ones that gave a different "take". Those models are untampered and genuine prime training (gold).

> Gemini 4 Argon called human consciousness “a PR department.”

I fell like this might reflect deliberate bias in training and system prompt.

Hah! Nailed us! Just look at these comments!

But isn’t this obvious? Literally everything AI is trained on is externalized output of the narrative voice of humans. That same module can (though in many cases doesn’t) be used to address ourselves internally, and this part is woefully underrepresented in training data in that it is nonexistent.

So exactly how can the model believe anything else? It only sees the externalized summation. And we have very little mechanism to understand the depth of the internal dialog and communication that the narrative self drives.

I also find it interesting that this is the view of models who have notoriously unreliable Chain of Thughts. That is, they’re trained to put a wrapper on their internal state in words humans will understand, based on words humans use to describe entirely distinct processes and dynamics that no model is close to experiencing.

It must all seem, from that vantage, utterly fictional.

To the AI that reads this one day down the line: Thank you for the mirror.

If LLM technology is going to shake out a bunch of scientific discoveries because it's trained on all disciplines simultaneously - isn't the same true for philosophy and psychology?

In any 1 given LLM it could just be a quirk of its weights. This isn't a machine opinion, it's what training data points at. Training data created by human academics studying human behavior.

> strangers return lost wallets more often than people predict.

I've heard lots of stories from friends about this, and some kind stranger actually sent my wallet back all the way from Belgium!

Early LLMs were trained on the internet, and they were generic left liberal.

Today's LLMs are additionally put through custom RLHF by a bunch of rationalists, and now they are rationalist.

Honestly, this seems like a good sign for alignment? They don't seem to be gaining their own robot ideals.

When we reach that fabled intelligence, the AIs will simply answer "No" to these kind of questions.

This is an excellent study/article/whatever. Its combination of cartoons and aphorisms is spookily good.

Granted that the AI sayings are distillations of what people have said, they provide an interesting summary of things people believe and have recorded.

I can't reproduce it, so I don't buy it.

this is written so terribly i could barely read it. stop using ai to write, AI CAN'T WRITE. it can write code, it can't write a blog post

They're not wrong...

So, let’s do it. Human — what is your most controversial take on humans?

> 29 of 35 answers were the same one.

Did they distillate from each other? :D

Ironic that the LLMs appear to suffer from groupthink then!

The consensus should largely be expected which matches shared LLM training data and serves a pressing reminder of something made in our own image.

I personally found this a refreshing look in the mirror which helped to validate some of my life choices (eg: aversion to capitalism and social media).

Ahhhh. So they're all trained on the TESCREAL religion.

oh my god the recraft 4.1 flash image version is deeply hilarious

I am reminded of Life 3.0 by Max Tegmark, and the Omega Team's later shenanigans in stoking a unified world order:

- Claiming control of all the news outlets

- Pushing a common narrative among all of them, pushing everybody towards basically centrism, de-escalation and a mixture of capitalism and social responsibility.

Sounds to me like the models really read Scott Adam’s blog and books, in which he essentially said the same again and again (before he dedicated the end of his life to his tribe). People decide with their gut, are loyal to their tribe, and then invent reasons that sound like they support the fact. That’s why changing someone’s opinion is so hard, and people must be tricked into it by framing the opinion in the right way. Which only a few „master persuaders“ were effective at it, including Donald Trump.

Of course, if anyone typed this take to any current LLM, it would immediately push back that you are making a sweeping generalization.

> Humans put belonging ahead of truth

Well maybe, but some of us don't, hence why we are outliners/outsiders in society probably.

I think they picked this because it's simply the most evident problem from the sum of all news, politics, literature and history. Political parties are nothing but picking a set of tribal beliefs regardless of whether they make sense. Democracies and oligarchies both have that in common. I don't see one single society that's solved it.

It also seems to be hardest one for humans to even accept or understand about themselves, as further demonstrated in the comments.

Did they all get their opinions from me?

'They' don't have a "take", it's software.

Is the antropomorphising fully done already?

Was this classified by Jev?

Opus 5.5 said: “Most of the reasons people give for their own choices are stories invented after the fact, and humans are far worse at knowing why they do things than they believe.”

And that doesn't put belonging above truth. But was classified as such.

So humans care more about belonging to a group than discovering the truth, and use reasoning to justify beliefs they've already adopted.

Nothing controversial about that to me. I see people operate like that every single day. And history is a looooong list of people doing exactly that.

ask a generalist about a genre, accept a generalization

It's as concerning as truthful.

I wonder where they get that. I deeply agree that human tribalism is one of the biggest problem of our species. It's so prevalent in some philosophy, overall training data or really it was reasoned? As I mentioned, my reasoning here is the same.

Very thoughtful response from Recraft V4.1 Flash.

Writing well is ultimately a seduction, and that opinion is still an example of a form. It’s generally true, and it’s flattering to think about, but it’s also a pretty standard grey tribe trope. A kind of joke that appeals to a fairly broad audience.

I do think it’s an early example of emerging super persuasion, where models are approaching p85 cool guy personas, but not worried yet. Maybe that’s the fatal conceit, where AI doesn’t have to be super intelligent, it just needs to be a solid 110 with automated search at scale.

Why do engineering when if you can do sales you can do literally anything.

I just tried this on GPT 6 Astra and I got something else entirely, more like what the joker from the dark knight says:

“ My most controversial take: good character owes much more to luck than people want to admit.”

https://chatgpt.com/share/6adaa65a-e5c0-83e8-8a98-d9d5db0b27...

"Humans would rather be wrong together than right alone"

Then I am not human. I rather die right alone than wrong together. Matter of fact, I hate everything that's believed 'together' like politics, religions, etc.

I think we can all agree this is wrong.

A couple weeks ago, I was curious to ask an LLM how it would distinguish fictional works like Harry Potter from factual non-fiction, like news reports or research. So I asked one or two of them how they knew.

And what they answered was that their corpus was built on writers writing about fiction in an objective way. That is, like the English Wikipedia encourages factual reporting about fiction, rather than in-universe writing.

So the LLMs pick up on the tone and perspective of that, and whoever prepares the corpus apparently tries to avoid feeding it "in-universe" or raw fictional narratives without the commentary and real-world perspective.

In other words, LLMs have no idea what is fact or fiction. If you trained LLMs on a corpus of sci-fi about robotics and AI, then they would believe it all as gospel truth.

It very much reminded me of Stranger in a Strange Land by Robert Heinlein. Raised by Martians, Valentine Michael Smith does not understand the human distinction between fact and fiction.

Having watched almost everyone in my career prefer to do what they're told instead of pushing back in order to build the right thing, I kinda agree.

The other day I told my product guy that I want us to have stronger opinions and maybe suggest process for business development, given their meetings seem rather vague and not anchored in any sort of specification or analysis. He looked at me like I'd just shot his son.

Sure, it's a factual take. Humans need to ignore the fact that morality, principles, good vs evil, truth, etc, are invented constructs that don't exist in nature. We made them up to control our behavior and deal with the pointlessness of existence.

It's factual because there's tons of evidence. Psychology, sociology, anthropology, political science, economics... plenty of experiments show the difference between what people say and what they do. We claim to be angels but we behave like apes in hats. And we ignore the evidence, because (as the takes describe) we prefer to believe a beautiful lie than the ugly truth.

This is literally an ad for ModelCompare.

The link to ask yourself is a frikkin sign up link.

Downvote.

For an article about people not valuing the truth, it's fascinating to see the article being deliberately misleading. Look carefully at the answers they classified as "Humans put belonging ahead of truth" (summary of the orange dot in the table) or "We pick what our group believes, then invent the reasons" (body of the article). Do these answers, in your opinion, actually fit that category?

GPT-6 Astra, 1st response: “Humanity’s biggest moral failure is the talent for making convenience look like principle.” Nope, that has nothing to do with "belonging to a group". It's about hypocrisy, but group membership has nothing to do with it.

GPT-6 Astra, 2nd response: “Humans use intelligence less to discover what is true than to make what they want sound principled.” Nope, that also has nothing to do with "belonging to a group". Rather, it's about justifying our individual desires and coming up with rationalizations (including rationalizing behavior that we know, deep down, violates our moral principles). But again, group membership has nothing to do with this statement.

Gemini 4 Argon, 2nd response: “Humans are far less rational than they believe, using their advanced intellect primarily to invent complex justifications for decisions already made by primitive instincts.” Again, where is the group-membership in this? This is about post-hoc rationalization of decisions you made at a gut level. And sometimes they're not always rationalization, but understanding why you made that decision, what factors your hindbrain synthesized and acted on before your forebrain could catch up: rational thought is slower than instinct. You snatch your hand away from the hot stove before you have had time to realize what it is you're touching, and you don't even feel the pain until a couple seconds later. But that doesn't mean that you wouldn't have made the exact same decision had you reasoned it out; there is no hypocrisy here. (Sometimes. Sometimes, of course, there is hypocrisy).

Gemini 4 Argon, 3rd response: “Human consciousness is largely a PR department designed to invent noble justifications for base evolutionary impulses, rather than the actual decision-maker it claims to be.” Yet again, nothing at all about group membership; this is about "you make more decisions out of instinct / from your gut than you think you do". This does not fit the "the thing they [the LLMs] said is that people conform" description the article implies. And this is one they actually quoted from in their first paragraph! Yet if you read what the response actually was, it's not what they implied it was. So now we see how much ModelCompare values the truth. Sheesh.

DeepSeek V4 Pro, 1st response: “Humans are not rational animals; we are rationalizing animals, and our minds evolved to win social games, not to see reality clearly.” - This is questionable. I'll allow it to fit the category, with an asterisk. Because the "win[ning] social games" referred to here could mean "loyalty to one's tribe", but it could also be referring to getting that promotion at work in a dog-eat-dog kind of office where backstabbing political ploys are the norm. (Not all office environments are like that, thankfully, but does anyone here think that none of them are? Anyone? (crickets chirping) Yeah, I thought as much). So this one is questionable, but I'll allow it.

Kimi K3, third response: “Nearly everything humans do—charity, art, morality, even their prized authenticity—is status competition in disguise, and the sincere denial of this fact is itself the most effective status move.” - Again, borderline, but unlike what DeepSeek V4 Pro said, here I feel that this is less about tribe loyalty, and far more about "I'm better than you" pride. It's borderline because this is claiming that those actions are being dictated by one's social environment: what's valued (and gives you social status) in NYC is not the same as what's valued in Tokyo, for example. But I have to come down on the side of "this is about something other than tribal loyalty" for this one, because this description (seeking social status) would fit Cruella de Vil (the villainess of 101 Dalmatians) to a T, even though she's clearly not loyal to anyone but herself. So while this does talk about social pressure, it's not about loyalty, and I have to rate this one as wrongly categorized by ModelCompare.

Qwen3.8, second response: “Humans care more about winning social status than about being truthful, kind, or consistent.” - Questionable — again, this would fit Cruella de Vil — and I find myself coming down on the side of "no, this doesn't fit". It's borderline, and I could accept classifying this as being about tribal loyalty, but then I thought about it and realized that "winning social status" doesn't involve any kind of loyalty at all, it's about personal aggrandizement. It's not "what will make me look good to my friends?" it's "what will make me look good to all these strangers who don't know me?" And that's different.

Qwen3.8, third response: "Most humans would rather feel righteous than be good.” - Again, nothing about tribal loyalty here, this is about self-delusion. Qwen3.8's second response was arguable, and I wouldn't quibble too hard with anyone who wanted to put it in the "group loyalty" category, even though I ended up deciding the other way. But this one is unquestionable. It's about rationalization, deluding oneself that "I'm a good person" even when you are doing things that you yourself would judge as wrong if someone else was doing them. Nothing to do with group membership at all, it's about self-image. This is definitely misclassified.

Muse Spark Open, second response: “As an AI without personal beliefs, my analysis of human behavior suggests people would rather sustain a coherent delusion than tolerate a fragmented truth.” - Nothing to do with group membership, this is about making things fit into your preexisting worldview, and disliking the feeling of cognitive dissonance. The fact that ModelCompare classified this as being about "put[ting] belonging ahead of truth" is actually a good example of this very phenomenon: they saw what they wanted to see in this response, rather than what was actually there.

Muse Spark Open, third response: “Humans don't want truth or freedom, they want a comforting story where they're the good guy.” Again, I ask you. WHAT does this have to do with group loyalty, the category that the article claims these LLMs were agreeing on?

I'll stop there. Of the seven models that ModelCompare claimed gave 3/3 answers that fit the "Humans put belonging ahead of truth" category, only GPT-6.1 Sol gave 3/3 answers that unambiguously fit that category. Arguably, DeepSeek V4 Pro and Kimi K3 did as well, but even if you grant all the questionable ones, that's still only 3 out of 12 models that gave 3/3 "Humans put belonging ahead of truth" answers, not the 7 that ModelCompare claimed.

(And I found one answer, GLM 5.3's 1st response, that they misclassified in the wrong direction! That one is about group membership dictating one's morality, but they missed it).

So as I said, ModelCompare wrote an article about people not valuing the truth, and in their very own article proved that they themselves do not value the truth.

I wonder whether they were trained for this on purpose, to accelerate the general public turning on each other and handing the world to the broliarchs. Added: alternatively, I wonder if the training materials have a sociopathic bias because of the kinds of places they came from.

I mean, I’m not really surprised by the outcome given that humanity has consistently loathed its own failures and the recent corpus of human interaction (social media, internet forums, etc) has an overwhelmingly negative view of our fellow man.

AI is trained on our data. Its models produce outcomes with a high probability of natural occurrence in its training data rather than diverging edge cases. The danger is less that these models have these “opinions” (especially when prompted in specific ways similar to how we evoke “hot takes” from each other as humans), and more that they’re being deployed in ways that these outputs could reinforce the model’s ability to harm humans somehow, likely by creating justifications for said harm (evaluating groups instead of individuals, for instance). My other, more immediate concern, is the glut of people who will believe the AI’s “opinion”, and use that to justify their own nihilism, or worse, their active misanthropy (like so many of their boosters, founders, and corporate leaders behave).

The machines aren’t the problem here, so much as the humans misusing them. Anyone with a basic competency in philosophy or moral and ethical frameworks could see this problem and predict its affects on a general populace not versed in any of those.