What’s Out There
← Back to swiping
Language & textFreeCompany

HelpSteer2

NVIDIA (with Scale AI)

Prompt-response pairs rated on five attributes, small enough to inspect.

Human ratings of model replies for helpfulness, correctness, coherence, complexity, and verbosity, collected with Scale AI. One row is a prompt, a response, and the attribute scores. NVIDIA reports that a model trained on it reached top reward-model results at release.

Access

Cost
FreeNo charge.
License
Open licenseCC BY 4.0
Sign-up
No sign-up
How you get it
API and Bulk downloadJSON Lines, Parquet

What's in it

One row is
One row per prompt and response with attribute scores
Covers
Not geographic
Years
2024
Updated
One-time release
Size
10,000 to 100,000 rows
promptresponsehelpfulnesscorrectnesscoherencecomplexityverbosity

Quality

4 of 5

Professionally annotated with attribute-level scores, which is more useful than a single preference bit.

  • Responses are model-generated
  • Small enough that reward models can overfit

Connects to

Questions it could answer

  • Which attribute best predicts overall helpfulness?
  • How correlated are verbosity and correctness scores?

Similar data sets

  • UltraFeedback

    64,000 prompts, four model answers each, scored by GPT-4 on four aspects.

    Language & textOpenBMB (Tsinghua University)Free

  • GAIA

    450 questions that are simple for people but need browsing, tools, and multi-step reasoning for AI assistants.

    Internet & techGAIA benchmark team (Meta, Hugging Face, and AutoGPT collaborators)Free

  • HH-RLHF (Helpful and Harmless)

    Human preference comparisons that helped define how chat assistants are trained to be helpful and harmless.

    Language & textAnthropicFree

  • Llama-Nemotron Post-Training Dataset

    Millions of math, code, and reasoning examples used to post-train NVIDIA's Llama-Nemotron models.

    Language & textNVIDIAFree

  • Chatbot Arena Conversations

    33,000 side-by-side model chats where real users voted for the better answer.

    Language & textLMSYS (UC Berkeley and collaborators)Free

  • GPQA

    Graduate-level science questions where outside experts score only 34 percent with Google.

    EducationDavid Rein and collaborators (NYU and others)Free