What’s Out There
← Back to swiping
EducationFreeCompany

FineMath

Hugging Face (SmolLM team)

34 billion tokens of math-teaching web pages, chosen by a classifier trained on Llama annotations.

Math-focused educational content filtered from Common Crawl by a classifier using Llama-3.1-70B-Instruct labels. One row is a web page with its text and score. Variants add a larger set combined with InfiMM-WebMath.

Access

Cost
FreeNo charge.
License
Open licenseODC-By 1.0
Sign-up
No sign-up
How you get it
API and Bulk downloadParquet

What's in it

One row is
One row per web page
Covers
Global web, mostly English
Years
Common Crawl snapshots
Updated
One-time release
Size
34 billion tokens (FineMath-3+); 54 billion with InfiMM-WebMath-3+
texturlmath educational scorecrawl date

Quality

4 of 5

Documented filtering with measured gains on math benchmarks when used in pretraining.

  • Selected by an LLM's judgment of educational value
  • Equation rendering and extraction can be lossy

Connects to

  • FineWeb-Edu: General educational counterpart from the same group
  • Natural Reasoning: Questions there were back-translated partly from FineMath

Questions it could answer

  • How do math-heavy sites rank by tokens retained?
  • What score threshold separates tutorials from problem lists?

Similar data sets

  • FineWeb-Edu

    1.3 trillion tokens of web text kept because a classifier judged it educational.

    Language & textHugging Face (FineWeb team)Free

  • FineWeb

    Trillions of tokens of cleaned English web text, with every filtering step published.

    Language & textHugging FaceFree

  • FineWeb2

    Pretraining text for over 1,000 languages, with the pipeline tuned and validated language by language.

    Language & textHugging Face (FineWeb team)Free

  • FinePDFs

    About 3 trillion tokens extracted from PDFs, a source most web corpora skip because extraction is costly.

    Language & textHugging Face (FineWeb team)Free

  • OpenR1-Math-220k

    220,000 math problems, each with two to four DeepSeek-R1 reasoning traces, many checked automatically.

    EducationHugging Face (Open-R1 project)Free

  • NuminaMath-CoT

    About 860,000 math problems with chain-of-thought solutions, from Chinese high school to olympiad level.

    EducationProject NuminaFree