What AI did to stackoverflow in a graph

342 points394 comments11 hours ago
lynndotpy

Any social organization needs to carefully consider their inclusion-exclusion curve with intentionality.

I think a lot of people might balk at the word "inclusivity" today, but StackExchange had ridiculously high barriers to participation, making it inclusive to the long-time users on the site, but exclusive to the newbie participants who found themselves blocked for asking questions. They slowly killed the site in this manner.

The community might have survived this folly, even with AI, because it was still the best place for people with qualms about AI to ask questions... Except until StackOverflow management alienated those users, too, by shoving AI down their throats in every facet of the site.

Even I had internalized the vagaries and neuroses of the SO community but I had heavy reticence to ask questions, knowing I'd have to consider all the ways a bully eager to use their powers might misunderstand me. I can't imagine asking a question there without having had lurked for longer than a typical Bachelor's + Masters program.

Peak at 207K, minimum at 588. That might be an incomplete date point, so using the next most recent value 1226, StackOverflow has lost 99.41% of its activity.

show comments
nolok

SO did that all to themselves when they decided they didn't want a community to form and that only question and answers mattered. The moment something else allowed to have a better way to get your answers, there was no reason to go there, because there was no community.

I still don't understand why anyone would go with that whole "no conversation please"

show comments
jeanlucas

I don't have the time to, but I'm surprised there aren't a lot of comments on the decline before chatGPT was released, but after SO was sold to Prosus [1][2]

Even the curious growth spike in activity happened just before the acquisition. I wish I had time to do this analysis a bit deeper, but you can look for SO activity up until when chatGPT was released, it is really noticeable.

---

[1] Stack Overflow acquired by Prosus for $1.8 billion: https://techcrunch.com/2021/06/02/stack-overflow-acquired-by...

[2] Prosus to acquire Stack Overflow for US$1.8 billion https://www.prosus.com/news-insights/2021/prosus-to-acquire-...

show comments
blablabla123

The graph actually peaked in 2014. That's a decade before AI became a thing while the Software engineering workforce grew a lot since then.

I think Stackoverflow was the last incarnation of romanticized old-school Q&A forums where you first had to earn your badges before being treated with respect. Luckily today's new projects have much better documentation, issue tracker's etc. And apparently AI is able to work with that by now...

show comments
TomMasz

I never had an LLM tell me my question was already answered and imply I was stupid for not finding it. SO dug its own grave and jumped in.

show comments
_ink_

Ironically it gives me: This IP address has performed an unusually high number of requests and has been temporarily rate limited.

That's also something what AI did to the internet :(

avaer

The collapse into a ghost town is striking.

Not sure I would blame it all on AI though, the incentives of SO only worked while there were worthwhile questions to answer and make you feel smart about. After that well dried up, the only thing left was the stuff AI can do with a prompt; ironically AI got a leg up by scraping SO.

This is similar to the evolution of Wikipedia, except the format of WP allowed it to transform into a feudal dictatorship of nerds who feel like they are deciding what's true, and they can get off on that.

SO did not have that kind of incentive to keep the nerds around.

show comments
sph

I used to read Coding Horror, I have been a programmer for longer than I had high speed Internet, yet somehow I never felt the urge to create a StackOverflow account. I have literally never browsed the site, always landed from Google and left when I found my answer.

There was an era of the Internet where moderators were seen as the solution to all the problems of Internet communities. Then we discovered that those people that enjoy playing petty bureaucrat for virtual karma will end up alienating normal users, especially in places that wants to maintain a certain standard of quality and not aim to the lowest denominator like Reddit, for example.

show comments
wtfHN26

Looks like SO was already dying since 2017.

I think other helpful places like reddit, discord, web forums etc might be what hit SO 2014-15 onwards.

AI seems to have given it a blow of mercy to end the misery.

show comments
chaps

Just tried to open stack overflow and was told their site was under maintenance. When I refreshed, it blocked my IP for refreshing too many times. I expect better from SO.

xyzsparetimexyz

Stackoverflow did it to themselves by having incredibly unhelpful users

show comments
khalic

Seing a bell curve and singling out a factor that appears only for the 15% of the total time demonstrates some pretty extreme tunnel vision

Edit: https://postimg.cc/n9nZGLmb

show comments
felooboolooomba

Peaked in 2014. That coincides with my experience. Something went wrong:

* Moderation went bad. I stopped moderating/flagging after it was deemed unhelpful?! I know it's hard to moderate a platform like that, but giving me a slap in the face when I volunteer my valuable time is not the way to do it.

* Questions closed because they weren't "programming questions", but obviously about tools devs use every day. Again and again, they were the TOP google results. You'd click on it and found a old question closed because it was considered off topic. As a business, you seriously need to ask yourself some hard questions when you fend off users like that.

show comments
arjie

They didn’t stand a chance. Even in the era where they made a great community etc etc AI would have destroyed them. Other people are just a poor source of information now that we have dramatically good search across all human knowledge.

JustRouzbeh

It’s pretty sad though. Like many developers, I used Stack Overflow a lot when I was starting out, and it helped me solve countless early programming problems

A lot of what we have today was built with help from that community

show comments
sota_pop

I recall some moves where SO announced they would be revising ToS to disclose their intent to repackage and use the site’s content for sale and/or model training.

Contributors responded by going to delete their own respective contributions en masse. Upon doing so, were banned by the platform mid-process which then led to people going back to revise their contributions to be false rather than deleted.

I guess that’s “LLM related”

pluc

So... nothing that it wasn't already doing to itself? There's no one drop where "AI got into the market", SO had been declining steadily for years. I actually expected this post to be about how SO survived by selling its internal organs to AI.

Now do a graph for the money.

https://www.wired.com/story/google-deal-stackoverflow-ai-gia...

show comments
robryan

Some of the pre-ai decline in questions might just be that they had filled out of alot of the question space. What might be more interesting is the traffic graph as it would be possible to have a decline in questions but still have traffic rising to the existing ones.

Today I'd expect even when someone is googling and a question is relevant that most people will just read the AI overview.

Kuinox

The stackoverflow moderation is the reason I do not post on it. You have middle party with no competence on the technology trying to do useless moderation.

Instead I directly go on the project github page and ask the question directly to the mainteners.

hazrmard

Does the peak starting in mid-2020 correspond to mass speculative / adversarial / bandwagon hiring by tech companies during the pandemic?

esskay

Stack overflow was always going to die. AI just sped it up. The misconception that it was a community is surprising. People went there for an answer and left, very few would stick around, not only because there was no incentive, but if you did you'd likely get crapped on by one of the hostile moderators which would ensure you'd leave and never come back, because who wants to willingly be treated badly.

It was basically an imposer syndrome enforcing machine.

chuckadams

One thing that might have helped SO is if they actually embedded the supposed duplicate, and its answer, in the question, then had a checkbox for "was this the same as your question?" SO was never in the habit of listening to suggestions unless it was to nitpick them to death on meta, and there were plenty of other self-inflicted wounds with no technical quick fix.

armchairhacker

The graph starts falling shortly after 2020. AI certainly contributed but Stack Overflow was dying without it.

hbcdbff

Interesting that you can see COVID in the graph

cpburns2009

StackOverflow was on decline due to mismanagement and hostility towards the community. This was well before AI. AI was just the death blow.

dwedge

I still use stack exchange, or I did until this week. I was looking for help with something and the answers and comments are intersliced with advertisements (albeit internal ones).

It's obvious that LLMs affected their traffic by a huge amount, but making the page flow worse for me was their doing

Alien1Being

The hostile moderators killed stack overflow.

amelius

I miss Joel Spolsky's writings especially in this dark age of AI.

neals

This made me browse through my StackOverflow history. Funny to see how I though I was such a skilled developer, though the questions I asked and the answers I gave 16 years ago... cringe.

geoffbp

Hug of death? Doesn’t seem to load for me

ivankra

Pretty sure they did it to themselves with terrible policies and moderation. AI was merely the final nail in the coffin.

Interesting to compare with MathOverflow which has distinctly different policies (only research-level questions) and professional community: https://data.stackexchange.com/mathoverflow/query/1953768/st... - also falling lately, but by a factor of 2-3x from peak rather than 1000x.

adamtaylor_13

AI might've delivered the final blow, but Stack Overflow was in decline LONG before LLMs came on the scene.

I read a great article not long ago outlining the full series of events and changes that led to its downfall. I wish I could find that article, but I've forgotten where it was.

jurf

I never understood the point if having the unfathomable churn of thousands of new questions per day. The value of SO to me was always a knowledge base with reputation mechanics, and that did not change. I still default to searching before asking AI.

red_admiral

I had the same experience as the next 100 or so commenters here. Asked about how to do something in Win11, got the question closed as a duplicate because there was already a Win 8 version with an answer that no longer applied. But apparently I could "leave a comment" on the old answer.

code_duck

I’m surprised the site had that little activity, relatively, around 2010. That’s when I was using it the most. It seemed plenty large to me at the time… I can’t imagine the experience was that great a few years later. I wasn’t really paying attention by the time it reached the peaks later that decade.

I always found the format of the side obtuse and the culture not very welcoming. My most popular answer ever was something about JavaScript from 2008 or 2009, and to this day, people come in and say “this isn’t the way to do it, this is outdated“. No kidding, but every new question about that gets closed as a duplicate.

anticensor
show comments
pdpi

Looking at that chart, AI seems to have not done much of anything at all to Stack Overflow. They were already in sharp decline before LLMs became widely available.

show comments
EspressoGPT

Good riddance. The graph peaked in 2014 and started to gradually go down in 2017, with the release of LLMs only adding fuel to the fire. They did this all to themselves with their way of how people are treated there.

Funnily enough, there's now a "StackOverflow for Agents": https://agents.stackoverflow.com/recent

asveikau

Looks like the decline started before the ai boom.

I can relate. I was active there from 2009 until about 2014, which looks rather like a plateau in the graph. It still showed up in Google searches but I mostly just lost interest in participating.

momocowcow

Can it please do the same to reddit?

show comments
mark-r

There's no need (or reason) to blame AI. Between the culture of discouraging new questions as seen in the comments on this thread, and the fact that Google can easily find existing answers, the value of asking new questions has clearly gone way down.

waldothedog

I am surprised how early the overall downward trend developed. There is no doubt LLMs put a nail in the coffin, but the 5 years from 2017 to 2022 look to have brought a non trivial decline of their own

jwsteigerwalt

My propensity to participate was definitely decreased when I would always see others editing and nitpicking my contributions. The value and character of my contribution was unchanged, but now it was “shared” with someone else who edited it…

frenzcan

While I never posted much to Stackoverflow I have fond memories of it as a sole developer, finding other people with similar issues and the quality solutions offered that often got me out of a jam.

dmurvihill

Looks like StackOverflow was already declining by the time ChatGPT came out

invader

Step 1: Here emerges a platform where everyone can ask, answer, or discuss questions on software development.

Step 2: The platform becomes the ultimate knowledge base with community-curated answers on virtually any question related to software development.

Step 3: Another company scraps the community-driven database to train its model.

Step 4: The model is so efficient that people start asking questions of the model, killing in the process any traffic to the platform that helped to create it in the first place.

Step 5: Profit. People who spent years asking, answering, and curating programming knowledge for free are now paying for that knowledge repacked in the model weights. The original knowledge base is essentially dead.

Question: What programming knowledge base will be used to train future models?

Are we at the Skynet moment where people will be totally cut out of the loop from now on?

show comments
Someone1234

ChatGPT was released in Nov 2022, and frankly wasn't very good originally. The SO decline started occurring almost two years ahead of that, and was already on a sharp decline before ChatGPT shipped, and certainly before ChatGPT actually became good.

This is revisionist history. People told SO that they were leaving for YEARS because of how incredibly toxic it had become. It was already giving outdated answers before ChatGPT shipped, because new questions/potentially updated answers were [Closed] [Dupe] immediately.

Their answer was essentially "We aren't a Q&A site, we're trying to be a knowledge base! So closing all questions on a Q&A-stylized site, and extremely abrasive moderation, is working as intended."

They entirely did this to themselves. The community was toxic, their policies were toxic, and they didn't listen when warned as such repeatedly - just doubled down.

show comments
clickety_clack

The site looks like it was actually dying since 2014 and AI just turned off the life support.

It was such a hostile environment. It always seemed like you basically had to already know the answer to ask a question.

LunicLynx

I think Ai is not the issue here. SEO on the other hand very much. It’s not like any one ever went to stackoverflow to find a solution, it was just that they were the google results for a lot of things

esjeon

I've only posted one question to SO, and it was enough to dislike the whole platform. LLM didn't kill it. SO killed itself with the broken community structure.

fantasticwaddle

Wow!! I checked for English learners, Artificial Intelligence and GenAI as well and even they suck :D

Guess where these people went? Reddit?

speedgoose

I will miss their yearly developer survey. Otherwise I won’t miss them. What a frustrating experience it was.

show comments
otterdude

Where will AI's get the training data to answer questions now?

show comments
infecto

AI was the final nail but SO was already on a downward trajectory imo. Too much angry rule setting and confident jerks.

hnthrow10282910

Honestly SO helped me a lot in Uni 10 years ago. However I was banned 5+ times for just asking a normal question with attempts at answering. Can’t say I’m surprised. It was not welcoming, massively exclusive and had a rude community. RIP

peterbmarks

Didn't Stack Overflow have a similar impact on Experts Exchange?

npn

Did they cry about it? No right? Don't apply your own standard then judge them about it, petty people.

Stackoverflow aimed to be a knowledge base. And knowledge base has a ceiling limit. They simply reached the point that almost all questions (regarding the knowledge) were asked for them. You can argue that newer or niche libraries or languages knowledge is still lacking there, but I have never seen them getting closed, just not answered.

calvinmorrison

just today I googled "convert PDF to Jpg" and the first stackoverflow answer was a hit on google and the question was "CLOSED, NOT APPROPRIATE".

IshKebab

AI and ridiculously aggressive moderation. If it had been a more welcoming place it probably would have lasted longer.

ahmetson

When an ecological shoes company pivot to AI, I wonder why StackOverflow executives don't pilot for AI now.

show comments
luciana1u

asking why SO declined is itself a question that would get closed as a duplicate on SO

quaddoggy

Perhaps the harshest lesson of stackoverflow is that it represented what happens when you give programmer-types unfettered control of a culture. A bitter pill indeed.

erelong

As others said it wasn't just AI but their excessive moderation

splittydev

Honestly, I think that's a good thing. A lot of questions were either duplicates of existing questions, or close derivatives of them. If I had to guess, probably 90% of SO questions already had a solution somewhere on SO. AI surfaces these solutions much quicker, so you don't have to ask. Novel questions or bugs that can't be answered or fixed by AI still get asked, and mods have less spam to deal with. I fail to see the issue here.

dudul

SO's downfall started way before AI. A decade or so ago it was always full of interesting questions, people were giving detailed answers, there was sometimes some debate in the answers, etc

And then it started being stupid questions. People who clearly had barely tried anything and just rushed to SO with a half baked question. Answers were just pointing to another thread that already provided the answer. It definitely started before LLMs. I think it lined up with the aggressive "learn-to-code" push.

ipaddr

Should read what Google did to remove sites from search results.

gcanyon

AI didn't start the decline, it just finished it.

tsss

Yeah, I don't remember when was the last time I even visited stackexchange. AI is so much better, it's not even a contest. The real question is where AI will get its knowledge in 10 or 15 years when there is no training material anymore...

econ

Did anyone use the site search? Whenever I tried it it was disappointing. After ~two attempts I always went back to Google. Having the answer is of no use if you refuse to give it. LLMs didn't happen overnight. With all the aging questions, perhaps it was always doomed to be replaced by something.

j45

Just like stackoverflow saved developers from experts exchange, it might be able to save us from what is coming from AI being an averaging engine by default and generating average code. Hopefully it's average but always works.

ChrisArchitect

Discussion in January:

Total monthly number of StackOverflow questions over time

https://news.ycombinator.com/item?id=46482345

And previously in 2025:

Stack overflow is almost dead

https://news.ycombinator.com/item?id=43999125

vcryan

They had a good run!

mohammedmsgm

no wonders, this will keep going on same trend

ReptileMan

Slightly accelerated their decline. You have a drop around chatgpt release then the slope returns to its previous pace of decline.

mid-kid

Except for covid, it seems the decline was already there.

show comments
baist0

The site for lazy code monkeys is dead.

TheRealPomax

I can't see any specific "and then AI happened" in this graph? SO made a lot of dumb choices that made it less and less useful for people independent of forcing AI in there, nothing in this graph is a clear indicator that AI was even a blip on the rapid decline of a service intent on making itself as poor an experience as possible for folks wanting to help other folks.

pknerd

Finally, something good done by AI against these modern-day dictators and pharaohs.

show comments
exe34

What I like about AI is that it doesn't close my chats as "duplicate" and link to something unrelated. It doesn't refuse to tell me how to do something just because there's another way to do something else that I am not interested in and didn't ask for.

moralestapia

Hehe, I'm so glad I blew the lid on this thing some time ago.

Mods were so shitty I always wanted to have my schadenfreude on them.

cynicalsecurity

StackOverflow was a pretty toxic and hostile place. I'm surprised they did nothing to fix it. And I'm not speaking of rainbows and unicorns, it was really easy to stop punishing people for asking questions - it was a web-site for asking questions after all.

Then they forbid using AI to answer questions - another huge miss. They could have leveraged AI as a great cool gig on their web-site - they didn't. Too bad.

nurettin

I don't think it was AI, I seem to remember that google broke search or SO SEO broke to the point where it wouldn't even point at the right SO article. There used to be a lot of commotion on the forums about how broken google search became for them.

Snoopfrogg

Sadge

show comments
zuzululu

people deride stackoverflow but has anybody been in those chat rooms? i've never encountered such hostile and arrogant mod and crowd. its the same frustration majority of the population have with people who take things literally and dissect every little thing you say to the point of being weird.

i dont feel guilty for creating a few hundredsaccounts on there to essentially get coding work done for free in the early days. I would have a script where I ask a question in the laziest way possible, post my code, and wait till some sucker fixed it for me. On a good day I could get roughly 16~21 questions answered. If they blocked me I would just use another account. I would also upvote my own questions if i wanted to get them answered quickly. eventually all of the accounts got banned but I've been able to ship a SaaS in php with barely knowing the language.

frb

By now I’m more and more starting to wonder how this graph looks for Google itself

5701652400

same story for blogs

fHr

joining the space and getting to know this site in 2015ish it was toxic af, well deserved

uwagar

that must be depressing to the owners and the investors.

phendrenad2

AI didn't kill SO, SO was already declining due to toxic users and lack of organization. The toxic users were dunning-krugerian anal-retentive mini-Napoleons who delighted in locking anything slightly off-topic and merging slightly-related questions, and the lack of organization was a tendency for people to give incorrect answers but still get upvoted (due to Google search surfacing the page in the wrong context).

charcircuit

If there is not allowed to be duplicate questions isn't it by design that as the site and industry matures the number of posts go down.

simianwords

The company my friend works for has a slack channel for help with code, like an internal stackoverflow. It’s almost inactive now.

I asked to see one of the questions from 2024 - it could have been solved with one LLM search.

We have eliminated a whole genre of peer to peer communication.

show comments
casey2

There's always going to be lots of latent insecurity among amateurs when a pro shows up.

Honestly because of this and the relative lack of actual pros on the site, real pros will get pushed out and the site will actually build a collection of misinformation. That's probably why pros feel that software quality has dropped so much in since stackoverflow.

BrandoElFollito

SO is the second thing I liked that was broken via "we cannot have nice things". The first one was UseNet.

I was on SO for 14 years, with an accumulated rep of a few hundred thousands. At the beginning the crisp philosophy of the site was great: a question, and answers. Sometimes comments. I believe it set the tone to questions today, without the hello everyone at the beginning and kind regards at the end. The aesthetics of the site were good too.

And then, somewhere around 2018 I think, things started to go south. Meta became a lair of psychopaths with an ego they could not loft. Asking a question over there meant immediate downvotes.

Then came the elitist groups, such as in the Golang section. I asked nice questions that were immediately downvoted at nauseam. This was not the case in other groups where you could find actual help.

Some other SE sites went that way too (cybersecurity, some linuxes) and I gave up completely.

There are however wonderful, more or less niche sites that are still there (LaTeX, cooking, ... ← please do not break them), they thrive because they are small-ish and the egos do not fly too high.

Otherwise I moved to asking questions on Reddit, which is a ht or miss.

deadbabe

Now that Stack Overflow is mostly dead, what's the experience of asking a question there? Will you still get berated or are people chilled out?

bjourne

It wasn't only LLMs it was also the downright user-hostile attitude prevalent on many sites on the SE network: https://ibb.co/WWgwNBpX

Yeah, bro, I'm not a statistics professor so I can't provide you with the "details or clarity" you need. I tried my best and if that's not enough, fuck it. Same story on history.SE: https://history.stackexchange.com/questions/60710/how-did-hi... If you're gonna require "evidence of prior research" I won't bother. The bots are way friendlier and just as knowledgeable.

The golden goose were users asking questions, not the anal-retentive content curators. SO let the latter drive away the former.

chriscrisby

Stackoverflow deserved to die

shevy-java

This is IMO wrong. StackOverflow died way before AI - and way before 2020 too. I think it had a peak time of only 3 or 4 years. It was created in 2008, and I would reason it took a few years, say, up to 2011; then it was semi-okish up to about 2015, roughly. Then it declined.

It still has some value today, as sometimes you can find useful information on SO, but its peak days are long over and I don't see how it can manage to come back, with or without AI slop. It would basically require a lot of re-design and some things that never worked, such as the karma system, should be changed. Also moderators - they kill sites. That happened to reddit - I gave up after censor-mods constantly restricted everyone.

show comments
yalogin

The move the current companies are missing is to have a legislation declaring ai as a person. Just like how corporations are people, if ai is a person then they don’t have to show number of people fired, can argues content creation and engagement is through the roof and so many other possibilities. /s

Alien1Being

Wikipedia seems to be going the same way.

rlv-dan

Picking on SO and the mods in particular is a popular HN pasttime. I'd like to add that I interacted a bit with SO (1k points) and never really had any problems with them. I must be lucky...