What’s Out There
← Back to swiping
Social mediaFreeCompany

YouTube-Commons

Pleias

Transcripts of over 2 million YouTube videos, all posted under a CC-BY license, about 45 billion words.

Audio transcripts of videos shared on YouTube under a CC-BY license: 22.7 million original and automatically translated transcripts from 3.2 million videos on 721,000 channels. One row is one transcript with video metadata. It supplies conversational and spoken-word text for training.

Access

Cost
FreeNo charge.
License
Open licenseCC BY 4.0 (as stated on the card)
Sign-up
No sign-up
How you get it
API and Bulk downloadParquet

What's in it

One row is
One row per transcript
Covers
Global, many languages
Years
Not stated
Updated
One-time release
Size
22,709,724 transcripts from 3,156,703 videos; about 44.8 billion words
transcript textvideo IDchanneltitlelanguageupload date

Quality

3 of 5

The CC-BY filter gives clearer rights than general scraped text, but the transcripts are automatic and uncorrected.

  • Transcripts are automatic and error-prone
  • Uploader-chosen license is not always accurate
  • Contains opinions and personal speech

Connects to

  • YODAS v3: Web-crawled audio of CC-BY YouTube videos, with audio rather than just transcripts
  • Common Corpus: Open-license text corpus from the same company

Questions it could answer

  • Which languages dominate the transcripts?
  • How do transcript lengths vary by channel?

Similar data sets

  • YODAS v3

    Over 1.1 million hours of CC-BY web audio in more than 100 languages.

    Audio & musicESPnet (Carnegie Mellon University and collaborators)Free

  • AudioSet

    Two million 10-second YouTube clips labeled with 527 kinds of sound, from barking to bagpipes.

    Audio & musicGoogle Research (Sound Understanding group)Free

  • YouTube Data API v3

    View counts, comments, and channel stats for public YouTube videos, rationed by a daily quota.

    Social mediaGoogle (YouTube)Free

  • MMMLU (Multilingual MMLU)

    The MMLU test set translated into 14 languages by professional human translators.

    EducationOpenAIFree

  • Mozilla Common Voice

    Volunteers reading sentences aloud in 100+ languages, donated to the public domain.

    Audio & musicMozilla FoundationFree

  • LMSYS-Chat-1M

    One million real conversations with 25 LLMs, collected from Vicuna demo and Chatbot Arena visitors.

    Language & textLMSYS (UC Berkeley and collaborators)Free