What’s Out There
← Back to swiping
Internet & techBy applicationAcademic

CAIDA Anonymized Internet Traces

CAIDA (Center for Applied Internet Data Analysis, UC San Diego)

Packet-level traffic from commercial internet backbone links, the rawest view of the internet on offer.

Anonymized packet headers captured by CAIDA's monitors on high-speed backbone links in Chicago, San Jose, and New York, usually as one-hour samples, with payloads removed and IP addresses scrambled. Researchers use them to study traffic mix, flow sizes, security events, and protocol adoption. Access requires an application and acceptable use agreement.

Access

Cost
By applicationFree for approved researchers who request access and sign CAIDA's Acceptable Use Agreement.
License
Provider's own termsCAIDA Acceptable Use Agreement; publications must be reported to CAIDA
Sign-up
Application required
How you get it
Bulk downloadpcap

What's in it

One row is
One captured packet header (pcap), grouped into hour-long traces
Covers
U.S. backbone links (Equinix Chicago, San Jose, and New York)
Years
April 2008-January 2019
Updated
One-time release
Size
Individual traces run to hundreds of GB
timestampanonymized source IPanonymized destination IPprotocolportspacket size

Quality

4 of 5

Rare, carefully anonymized backbone captures with documented collection; only a few links and limited time windows.

  • Collection ended in January 2019
  • A handful of links cannot represent the whole internet
  • Payloads removed and addresses anonymized

Connects to

Questions it could answer

  • How did the share of UDP traffic change between 2008 and 2018?
  • What is the distribution of flow sizes on a backbone link?

Similar data sets

  • Cloudflare Radar

    Global internet traffic, outages, attacks, and bot trends, seen from one of the web's largest networks.

    Internet & techCloudflareFree

  • HTTP Archive

    Every month, millions of websites crawled to record exactly how the web is built.

    Internet & techHTTP Archive (community project sponsored by Google and others)Free

  • USDA Forest Inventory and Analysis (FIA)

    A field crew has measured trees on a permanent plot roughly every 6,000 acres of U.S. land, for decades.

    BiodiversityU.S. Forest ServiceFree

  • INRIX Traffic and Trip Data

    Road speeds and trips pieced together from GPS pings of connected cars, fleets, and phones.

    TransportationINRIXPaid

  • StreetLight InSight

    Traffic counts for every road in the US without a single pneumatic tube, modeled from phone and vehicle data.

    TransportationStreetLight Data (a Jacobs company)Paid

  • M-Lab NDT (Network Diagnostic Tool) Data

    The open data behind Google's 'internet speed test', with raw results back to 2009.

    Internet & techMeasurement Lab (M-Lab)Free