What’s Out There
← Back to swiping
Internet & techFreeCompany

Stack Exchange Data Dump

Stack Exchange, Inc.

Every public question, answer, comment, and vote on Stack Overflow and 170+ sister sites.

Per-site archives of Stack Exchange content (Posts, Users, Votes, Comments, Badges, Tags, PostHistory, and PostLinks) for Stack Overflow and its sister Q&A sites, from cooking to mathematics. It is used to study programming knowledge, expertise, and online community dynamics, and was a staple of language-model training sets.

Access

Cost
FreeFree download; recent dumps are also offered through logged-in Stack Exchange accounts with additional terms.
License
Open licenseCC BY-SA 4.0 (attribution required)
Sign-up
No sign-up
How you get it
API and Bulk downloadXML (7-Zip)

What's in it

One row is
One row per post, user, vote, comment, or badge, in separate per-site XML files
Covers
Global
Years
2008-present
Updated
Quarterly
Size
Tens of millions of questions and answers; Stack Overflow alone is a large share
post IDpost typescorebodytagscreation dateaccepted answeruser reputation

Quality

4 of 5

Complete, well-documented schema and a long history; distribution terms have shifted as AI companies began using the data.

  • Stack Exchange changed how and where it publishes dumps in 2023-2024
  • Deleted posts are excluded
  • Question volume has fallen sharply since 2022

Connects to

  • GH Archive: Tie questions about a library to its repository activity
  • The Pile: Stack Exchange was one of the Pile's 22 components

Questions it could answer

  • How fast did new Stack Overflow questions decline after ChatGPT's release?
  • Which tags have the lowest share of answered questions?
  • How long does it take to get an accepted answer by language?

Similar data sets

  • The Stack v2

    Source code in more than 600 programming languages, with provenance tied to Software Heritage archives.

    Internet & techBigCode (Hugging Face and ServiceNow)Free

  • Hacker News Complete Archive

    Every Hacker News story, comment, and poll since 2006, refreshed every five minutes.

    Social mediaopen-indexFree

  • Pushshift Reddit Archive

    The archive of nearly every Reddit post and comment, until Reddit shut researchers out in 2023.

    Social mediaPushshift (Network Contagion Research Institute)By application

  • GH Archive

    Every public push, star, fork, and issue comment on GitHub, archived hour by hour since 2011.

    Internet & techGH Archive (Ilya Grigorik)Free

  • Raiders of the Lost Kek: 3.5 years of 4chan /pol/ posts

    Over three years of full 4chan /pol/ threads, with named entities and toxicity scores added.

    Social mediaPapasavva, Zannettou, De Cristofaro, et al.Free

  • Lightcast Job Postings

    Billions of scraped, deduplicated job ads, each tagged with skills: the data behind much skills research.

    LaborLightcast (formerly Emsi Burning Glass)Paid