What’s Out There
← Back to swiping
Social mediaFreeCommunity project

Hacker News Complete Archive

open-index

Every Hacker News story, comment, and poll since 2006, refreshed every five minutes.

A live-updated mirror of all items posted on Hacker News: stories, comments, Ask HN, Show HN, jobs, and polls. One row is one item with its author, time, text, and parent. The data comes from the public Hacker News API, and the repository is maintained by a third party.

Access

Cost
FreeNo charge.
License
Open licenseODC-By 1.0 (applied by the repository maintainers)
Sign-up
No sign-up
How you get it
API and Bulk downloadParquet

What's in it

One row is
One row per item (story, comment, job, or poll)
Covers
Global online community
Years
2006-present
Updated
Real time
Size
10 to 100 million items
item IDtypeauthortimetexttitleURLscore

Quality

3 of 5

Complete and updated, but it is a third-party mirror whose license claim on user content is questionable.

  • Third-party mirror, not Y Combinator
  • User-generated text with unclear rights
  • Deleted and dead items may be present or missing

Connects to

  • Pushshift Reddit: Comparable archive of another online discussion community
  • arXiv Complete Corpus: Tech-community discussion that often links to arXiv papers

Questions it could answer

  • How has the share of AI-related stories changed over time?
  • How do comment counts relate to posting time and score?

Similar data sets

  • Pushshift Reddit Archive

    The archive of nearly every Reddit post and comment, until Reddit shut researchers out in 2023.

    Social mediaPushshift (Network Contagion Research Institute)By application

  • GH Archive

    Every public push, star, fork, and issue comment on GitHub, archived hour by hour since 2011.

    Internet & techGH Archive (Ilya Grigorik)Free

  • Stack Exchange Data Dump

    Every public question, answer, comment, and vote on Stack Overflow and 170+ sister sites.

    Internet & techStack Exchange, Inc.Free

  • Archive Team Twitter Stream Grab

    Twelve years of Twitter's free 1% sample stream, saved month by month until the tap closed.

    Social mediaArchive Team (hosted by the Internet Archive)Free

  • Raiders of the Lost Kek: 3.5 years of 4chan /pol/ posts

    Over three years of full 4chan /pol/ threads, with named entities and toxicity scores added.

    Social mediaPapasavva, Zannettou, De Cristofaro, et al.Free

  • XWord Info New York Times Crossword Archive

    Every New York Times crossword since the first on February 15, 1942, with grids, clues, and constructors.

    GamesXWord InfoFree tier, paid upgrades