> This suggests that people are drawn to AI that unquestioningly validate, even as that validation risks eroding their judgment

I believe this is a larger problem than just AI.

The internet has helped people surround themselves with only voices that agree with them and validate them, often to their detriment.

There are entire online communities urging people to cut others out of their lives over the slightest disagreement.

You're absolutely right!

It's a pretty overdone joke at this point, don't you think?

It's not a joke-it's an honest fact.

You made an excellent point! (could not resist that one)

I don't know. Upvotes often do the same thing, especially in siloed communities. I feel like this is a larger problem -- people leaning into extremifying their views or just playing to an audience -- even though one might frame it as "prosocial" because it happens within the context of an online community.

> Upvotes often do the same thing, especially in siloed communities.

Yeah. I've gotten caught in this pattern here on HN. Post something, there's some disagreement but then I see the quiet upvotes trickling in, sometimes by the dozen. That sort of signal slowly convinced me I was right about plenty of stuff.

I used AI to datamine all of my HN comments and find those patterns. Then I started asking the AI to steelman the hell out of my world view, every single argument.

Both could be true. People follow incentives.

I think this goes along way to explain people's very defensive reactions when you are skeptical about Agentic Development.

I'm one of the people who gets accused of this. I don't mind skepticism. But every time I turn around, someone's claiming nobody gets any value from these tools and anyone who says otherwise is deluded or running a scam. That gets really old.

I can believe people get value out of them. I think I do.

But "OH MY GOD EVERYTHING HAS CHANGED THE OLD WAY IS DEAD 10X MORE PRODUCTIVE" - no. If that were true, we'd notice it in the software all around us.

This is true, but likely happening in talk therapy too with overly sycyphantic therapists

Sure, but there is a marked difference between a therapist and an LLM Chatbot: you can't talk to your therapist for +4h a day, at any time convenient to yourself. It's also not a guarantee you're going to hit upon a therapist that is like that, versus a product that is very literally intended to maximise your usage of it.

a therapist should, if they follow their training, not be a sycophant whatsoever. CBT, for eg, is a multi-step process including Socratic self-dialogue, reframing practices, etc to guide the person towards the development of insight and healthier coping mechanisms