What’s Out There
← Back to swiping
Images & videoFreeAcademic

COCO (Common Objects in Context)

COCO Consortium (Microsoft and academic partners)

330,000 everyday photos with every person, dog, and fork outlined by hand.

Images of everyday scenes with pixel-level outlines of objects in 80 categories, five human-written captions per image, and body keypoints for people. It is the standard benchmark for object detection, segmentation, and image captioning, and most detection models report COCO scores.

Access

Cost
FreeFree download.
License
Open licenseAnnotations under CC BY 4.0; images remain under their Flickr licenses
Sign-up
No sign-up
How you get it
API and Bulk downloadJPEG, JSON

What's in it

One row is
One image with its object instances, captions, and person keypoints
Covers
Flickr photos, worldwide
Years
Released 2014; 2017 split is the current standard
Updated
One-time release
Size
About 330,000 images, 1.5 million object instances, 80 object categories
image IDobject categorybounding boxsegmentation maskcaptionperson keypoints

Quality

5 of 5

Carefully annotated, versioned, and supported by an evaluation API; the default benchmark for detection.

  • Only 80 object categories
  • Images carry a mix of Flickr licenses, some non-commercial
  • Captions and people skew toward Western contexts

Connects to

  • ImageNet: Classification counterpart; models are often pretrained on ImageNet and fine-tuned on COCO
  • Open Images V7: A larger detection set with 600 box classes

Questions it could answer

  • Which object categories co-occur most often in everyday scenes?
  • How does caption wording differ for images with and without people?

Similar data sets

  • Open Images V7

    About 9 million Creative Commons photos with 16 million boxes and 61 million labels.

    Images & videoGoogleFree

  • ImageNet

    The 14-million-photo set whose 2012 contest kicked off the deep-learning boom.

    Images & videoStanford University and Princeton University (ImageNet project)Free

  • MultiCoNER Datasets

    Multilingual named-entity recognition data with hard cases like movie titles and short text.

    Language & textAmazonFree

  • Yale-CMU-Berkeley (YCB) Object and Model Set

    3D models and images of over 80 everyday objects used to benchmark robot grasping.

    Images & videoYale University and UC BerkeleyFree

  • Corpus of Contemporary American English (COCA)

    A billion words of American English, balanced across genres from TV scripts to academic journals.

    Language & textEnglish-Corpora.org (Mark Davies)Free tier, paid upgrades

  • FineVision

    17.3 million images and 24.3 million samples merged from many sources to train open vision-language models.

    Images & videoHugging Face (M4 team)Free