CAIDA Anonymized Internet Traces
CAIDA (Center for Applied Internet Data Analysis, UC San Diego)
Packet-level traffic from commercial internet backbone links, the rawest view of the internet on offer.
Anonymized packet headers captured by CAIDA's monitors on high-speed backbone links in Chicago, San Jose, and New York, usually as one-hour samples, with payloads removed and IP addresses scrambled. Researchers use them to study traffic mix, flow sizes, security events, and protocol adoption. Access requires an application and acceptable use agreement.
Access
- Cost
- By applicationFree for approved researchers who request access and sign CAIDA's Acceptable Use Agreement.
- License
- Provider's own termsCAIDA Acceptable Use Agreement; publications must be reported to CAIDA
- Sign-up
- Application required
- How you get it
- Bulk downloadpcap
What's in it
- One row is
- One captured packet header (pcap), grouped into hour-long traces
- Covers
- U.S. backbone links (Equinix Chicago, San Jose, and New York)
- Years
- April 2008-January 2019
- Updated
- One-time release
- Size
- Individual traces run to hundreds of GB
Quality
Rare, carefully anonymized backbone captures with documented collection; only a few links and limited time windows.
- Collection ended in January 2019
- A handful of links cannot represent the whole internet
- Payloads removed and addresses anonymized
Connects to
- Cloudflare Radar: Aggregated traffic trends for the period after CAIDA's collection ended
- M-Lab NDT (Network Diagnostic Tool) Data: End-user speed tests to compare with backbone traffic
Questions it could answer
- How did the share of UDP traffic change between 2008 and 2018?
- What is the distribution of flow sizes on a backbone link?