Skip to content

Latest commit

 

History

History

results

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 
 
 
 
 

Benchmark Results

This folder contains benchmark results for 14 SSL algorithms. We report the best error rate(top-1-1 and top-1-20 results can be found in drive). Each setting runs 3 different random seeds and computes the average performance with standard deviation.

Reproduction on Classic CV Benchmark

Datasets

Dataset #Label #Training data #Test data #Class
CIFAR-10 4 / 25 / 400 50,000 10,000 10
CIFAR-100 4 / 25 / 100 50,000 10,000 100
SVHN 4 / 25 / 100 604,388 26,032 10
STL-10 4 / 25 / 100 100,000 10,000 10

Results

Please see Classic CV for the complete table of results.

USB CV Results

Datasets

Dataset #Label #Training data #Test data #Class
CIFAR-100 2 / 4 50,000 10,000 100
STL-10 4 / 10 5,000 / 100,000 8,000 10
EuroSat 2 / 4 16,200 5,400 10
TissueMNIST 10 / 50 165,466 47,280 8
Semi-Aves 15-53 3,959 / 26,640 4,000 200

Results

Please see USB CV for the complete table of results.

USB NLP Results

Datasets

Dataset #Label #Training data #Val data #Test data #Class
IMDB 10 / 50 23,000 2,000 25,000 2
Amazon Review 50 / 200 250,000 25,000 65,000 5
Yelp Review 50 / 200 250,000 25,000 50,000 5
AG News 10 / 50 100,000 10,000 7,600 4
Yahoo! Answer 50 / 200 500,000 50,000 60,000 10

Results

Please see USB NLP for the complete table of results.

USB Audio Results

Datasets

Dataset #Label #Training data #Val data #Test data #Class
Keyword Spotting 5 / 20 18,538 2,577 2,567 10
ESC-50 5 / 10 1,200 400 400 50
UrbanSound8k 10 / 40 7,079 816 837 10
FSDnoisy18k 52-171 1,772 / 15,813 - 947 20
GTZAN 10 / 40 7,000 1,500 1,500 10

Results

Please see USB Audio for the complete table of results.