Skip to content

Self-Supervised Learning for OOD Detection (NeurIPS 2019)

Notifications You must be signed in to change notification settings

siihwanpark/RotNet-OOD

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Self-Supervised Learning for OOD Detection

A Simplified Pytorch implementation of Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty(NeurIPS 2019)

The code supports only Multi-class OOD Detection experiment(in-dist: CIFAR-10, Out-of-dist: CIFAR-100/SVHN)

  • Command
    • RotNet-OOD

      python test.py --method=rot --ood_dataset=cifar100

    • baseline

      python test.py --method=msp --ood_dataset=svhn

Results (OOD Detection)

  • Metric : AUROC
CIFAR-100 SVHN
Maximum Softmax Probability
(baseline)
0.6986 0.7190
RotNet 0.7931 0.9584
RotNet (rot loss only) 0.7132 0.9560
RotNet (KL divergence only) 0.7834 0.8522

Reference

[1] full code(by authors): https://github.com/hendrycks/ss-ood

[2] Using Self-Supervised Learning Can Improve Model Robustness and Uncertainty(NeurIPS 2019): https://arxiv.org/abs/1906.12340

[3] A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks(ICLR 2017): https://arxiv.org/abs/1610.02136

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%