What’s Out There
← Back to swiping
Internet & techFreeNonprofit

Arena Leaderboard Dataset

LMArena

Historical snapshots of the Arena leaderboard, showing how model rankings moved over time.

Periodic snapshots of the LMArena leaderboard across categories such as text with style control, with ratings and confidence intervals. One row is a model's rating in a category on a snapshot date. It is updated as the live leaderboard changes.

Access

Cost
FreeNo charge.
License
Open licenseCC BY 4.0
Sign-up
No sign-up
How you get it
API and Bulk downloadParquet

What's in it

One row is
One row per model, category, and snapshot date
Covers
Global users
Years
Historical snapshots to the present
Updated
Irregular
Size
1 to 10 million rows
modelcategoryratingconfidence intervalvote countsnapshot date

Quality

4 of 5

Backed by large-scale human preference votes. Ratings reflect arena voters' preferences, which may not match accuracy.

  • Votes reward style and length
  • Models can be tuned for the arena
  • Provider-submitted private model variants have affected rankings

Connects to

Questions it could answer

  • How quickly do new models climb the leaderboard?
  • How does style control change the rankings?

Similar data sets

  • Chatbot Arena Conversations

    33,000 side-by-side model chats where real users voted for the better answer.

    Language & textLMSYS (UC Berkeley and collaborators)Free

  • Every Eval Ever Datastore

    One schema for AI evaluation results scraped from leaderboards, papers, and local runs, so they can be joined.

    Internet & techEvalEval Coalition (community)Free

  • LMSYS-Chat-1M

    One million real conversations with 25 LLMs, collected from Vicuna demo and Chatbot Arena visitors.

    Language & textLMSYS (UC Berkeley and collaborators)Free

  • Llama-Nemotron Post-Training Dataset

    Millions of math, code, and reasoning examples used to post-train NVIDIA's Llama-Nemotron models.

    Language & textNVIDIAFree

  • MovieLens

    32 million movie ratings from 200,000 people: the benchmark behind decades of recommender research.

    Film, TV, & booksGroupLens Research, University of MinnesotaFree

  • Lahman Baseball Database

    Every major league player's season stats since 1871, in tidy relational tables.

    SportsSociety for American Baseball Research (SABR)Free