What’s Out There
← Back to swiping
Internet & techFreeNonprofit

PyPI Download Statistics (BigQuery)

Python Software Foundation (PyPI)

Every pip install of every Python package, logged and queryable in SQL.

A public BigQuery table recording each file download from the Python Package Index, with the package, version, installer, Python version, operating system, and country, plus a companion table of metadata for every release. It is the best public window into which software libraries people actually use, and how fast they upgrade.

Access

Cost
FreeData is free; querying it uses Google BigQuery, which is free up to a monthly quota and billed beyond.
License
Open licenseCreative Commons license (per PyPI documentation)
Sign-up
Free account
How you get it
APIBigQuery

What's in it

One row is
One row per file download (file_downloads) or per release file (distribution_metadata)
Covers
Global, with country codes
Years
2016-present
Updated
Real time
Size
Billions of downloads per month
timestampprojectversioninstallerPython versionoperating systemcountry code

Quality

4 of 5

Complete log of PyPI downloads straight from the source; downloads are not users, and CI systems and mirrors inflate counts.

  • Automated CI installs dominate many packages' counts
  • Downloads through mirrors and caches are not seen
  • Queries over the full table can be expensive

Connects to

Questions it could answer

  • How long does it take for half of a library's downloads to move to a new major version?
  • Which Python versions still account for meaningful downloads?
  • How fast are AI-related packages growing compared with web frameworks?

Similar data sets

  • GH Archive

    Every public push, star, fork, and issue comment on GitHub, archived hour by hour since 2011.

    Internet & techGH Archive (Ilya Grigorik)Free

  • SteamSpy API

    Valve does not publish sales, so SteamSpy estimates owners and playtime for every game on Steam.

    GamesSteamSpy (Sergey Galyonkin)Free

  • Seattle Public Library Checkouts by Title

    Monthly checkout counts for every book, ebook, DVD, and audiobook a big-city library lent since 2005.

    Film, TV, & booksSeattle Public Library (City of Seattle Open Data)Free

  • IGDB API (Internet Game Database)

    A structured record of video games across platforms, from release dates to franchises and age ratings.

    GamesTwitch (Amazon)Free

  • Netflix Top 10

    Netflix's own weekly rankings in about 93 countries since mid-2021, downloadable as spreadsheets.

    Film, TV, & booksNetflixFree

  • Sci-Hub download log of 2017

    A full year of Sci-Hub downloads, one row per request, with the paper's DOI and a geolocated city.

    Science of scienceAlexandra Elbakyan (Sci-Hub)Free