What’s Out There
← Back to swiping
Internet & techFreeAcademic

Libraries.io Open Source Repository and Dependency Metadata

Katz (Libraries.io)

Metadata on millions of open source packages and the dependencies between them, from many ecosystems.

A 2020 release of data from Libraries.io about software distributed on the Internet: projects, versions, repositories, and the dependency links between them across many package managers. It has seven CSV files and carries no information about the individuals behind the projects. Used to study software ecosystems and supply chain risk.

Access

Cost
FreeFree download from Zenodo; no account needed.
License
Open licenseCC BY 4.0
Sign-up
No sign-up
How you get it
Bulk downloadCSV (gzip)

What's in it

One row is
One row per project, version, dependency, or repository (across seven CSV tables)
Covers
Global
Years
Data as of January 2020
Updated
One-time release
Size
Seven CSV tables, millions of rows
package nameplatformversiondependenciesrepositorylicensestars

Quality

3 of 5

Largest public cross-ecosystem dependency data in its time; frozen in 2020 and ecosystem coverage varies.

  • Snapshot is years old
  • Dependency parsing quality varies by package manager

Connects to

  • deps.dev: Google's live dependency graph for several ecosystems
  • GHTorrent: GitHub activity data that can be joined to repositories
  • Software Heritage Graph Dataset: Source code archive to follow up on repositories

Questions it could answer

  • Which packages have the most dependents in each ecosystem?
  • How concentrated is risk in a few very widely used libraries?

Similar data sets

  • Biodiversity Heritage Library Metadata and Page Images

    Metadata and page images from the largest open digital library of natural history literature.

    BiodiversityBiodiversity Heritage LibraryFree

  • Open Library Data Dumps

    A wiki-style catalog of tens of millions of book editions, dumped monthly for anyone to download.

    Film, TV, & booksInternet Archive (Open Library)Free

  • OpenAIRE Graph

    A knowledge graph of publications, data, software, funders, and organizations drawn from many sources.

    Science of scienceManghi, Atzori, Bardi, et al. (OpenAIRE)Free

  • CVEfixes: vulnerabilities and their fixes from open-source software

    Security vulnerabilities linked to the exact code changes that fixed them.

    Internet & techMoonen & VidziunasFree

  • IATI Datastore

    Aid projects from over a thousand donors and NGOs in one standard format, down to single transactions.

    International developmentInternational Aid Transparency Initiative (IATI)Free

  • Crossref Public Data File

    An annual snapshot of every Crossref DOI's metadata, well over 150 million records, free as a torrent.

    Science of scienceCrossrefFree