Clarification of correct TSV file for CC3M?

[RylanSchaeffer]

Hi! Your instructions to download CC3M state "Go to https://ai.google.com/research/ConceptualCaptions/download and press download That's a 500MB tsv file"

However, when I go to that URL, there are three download buttons:

Your instructions then state to modify cc3m.tsv but none of the three downloaded files are named cc3m.tsv:

• Training -> Train_GCC-training.tsv (564 MB)
• Validation -> Validation_GCC-1.1.0-Validation.tsv (2.6 MB)
• Image Labels -> Image_Labels_Subset_Train_GCC-Labels-training.tsv (1.3 GB)

The instructions do state that the file should be ~500 MB, which roughly matches the file obtained by downloading the training split (Train_GCC-training.tsv)

Could you please clarify how to obtain the correct cc3m.tsv file?

[rom1504]

Good question, I don't have the answer. Maybe you can download all 3 files and see which one have the right number of sample and the right columns?

You may compare against https://huggingface.co/datasets/pixparse/cc3m-wds

[lishuai-97]

Hi! Your instructions to download CC3M state "Go to https://ai.google.com/research/ConceptualCaptions/download and press download That's a 500MB tsv file"

However, when I go to that URL, there are three download buttons:

Your instructions then state to modify cc3m.tsv but none of the three downloaded files are named cc3m.tsv:

• Training -> Train_GCC-training.tsv (564 MB)
• Validation -> Validation_GCC-1.1.0-Validation.tsv (2.6 MB)
• Image Labels -> Image_Labels_Subset_Train_GCC-Labels-training.tsv (1.3 GB)

The instructions do state that the file should be ~500 MB, which roughly matches the file obtained by downloading the training split (Train_GCC-training.tsv)

Could you please clarify how to obtain the correct cc3m.tsv file?

@RylanSchaeffer Hi! I have the same problem, have you solved it?

[RylanSchaeffer]

I switched to a different dataset.