Dataset Zoo

Here is the list of datasets currently supported in MMF:

DatasetsKeyNotes
CLEVRclevrwebsite, paper
MS COCO 2014cocococo has other types of data available (ie, detection), mmf only has coco caption dataset implemented, website, paper
MS COCO 2017coco17coco has other types of data available (ie, detection), mmf only has coco caption dataset implemented, website, paper
Conceptual Captionsconceptual_captionsgithub, website
Flickr30kflickr30kgithub
GQAgqawebsite
Hateful Memeshateful_memespaper
Localized Narrativeslocalized_narrativeswebsite
MM IMDBmmimdbwebsite, paper
NLVR2nlvr2website, paper
OCRVQAocrvqawebsite
OKVQAokvqawebsite
SBU Captionsmasked_sbuwebsite
Scene Text VQAstvqapaper
Text Capstext_capswebsite
TextVQAtextvqawebsite
VisualDialogvisdialwebsite
Visual Genomevisual_genomewebsite, paper
SNLI-VEvisual_entailmentgithub, paper
VizWizvizwizwebsite, paper
VQA 2.0vqa2website, paper
VQA CP V2vqacp_v2paper

We are adding many more new datasets which will be available soon.

Last updated on by Sasha Sheng