YouTube-Commons
Pleias
Transcripts of over 2 million YouTube videos, all posted under a CC-BY license, about 45 billion words.
Audio transcripts of videos shared on YouTube under a CC-BY license: 22.7 million original and automatically translated transcripts from 3.2 million videos on 721,000 channels. One row is one transcript with video metadata. It supplies conversational and spoken-word text for training.
Access
- Cost
- FreeNo charge.
- License
- Open licenseCC BY 4.0 (as stated on the card)
- Sign-up
- No sign-up
- How you get it
- API and Bulk downloadParquet
What's in it
- One row is
- One row per transcript
- Covers
- Global, many languages
- Years
- Not stated
- Updated
- One-time release
- Size
- 22,709,724 transcripts from 3,156,703 videos; about 44.8 billion words
Quality
The CC-BY filter gives clearer rights than general scraped text, but the transcripts are automatic and uncorrected.
- Transcripts are automatic and error-prone
- Uploader-chosen license is not always accurate
- Contains opinions and personal speech
Connects to
- YODAS v3: Web-crawled audio of CC-BY YouTube videos, with audio rather than just transcripts
- Common Corpus: Open-license text corpus from the same company
Questions it could answer
- Which languages dominate the transcripts?
- How do transcript lengths vary by channel?