Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Missing file #241

Open
gugu777 opened this issue Jun 7, 2024 · 8 comments
Open

Missing file #241

gugu777 opened this issue Jun 7, 2024 · 8 comments

Comments

@gugu777
Copy link

gugu777 commented Jun 7, 2024

Hi!
I couldn't find the file in the download link/ data/benchmark_imglist/cifar10/val_cinic10.txt, If possible, could you send me a copy

@zjysteven
Copy link
Collaborator

The v1 benchmark_imglist files can be found here, however I didn't see a val_cinic10.txt. Even if it were presented in v1 it definitely is removed in v1.5.

@Jingkang50
Copy link
Owner

Lemme try to find it.

@Jingkang50
Copy link
Owner

I thought we were following the data here https://paperswithcode.com/dataset/cinic-10 to get the list.
So if I could not make it to find the txt, please simply use the original data split

@gugu777
Copy link
Author

gugu777 commented Jun 12, 2024

The v1 benchmark_imglist files can be found here, however I didn't see a val_cinic10.txt. Even if it were presented in v1 it definitely is removed in v1.5.
However, the dataset partition file appears in the script cifar10_test_ood_mem.sh. Additionally, by default, I am unable to reproduce the experimental results in the paper. Could you please send me the correct parameters? Thank you very much.

@zjysteven
Copy link
Collaborator

Which exact script are you referring to? Is it cifar10_test_ood_sem.sh?

Also, by "paper" do you mean the v1 or v1.5 paper? A few datasets and methods presented in v1 are not considered in v1.5 (since v1.5 focuses more on the large-scale settings).

@gugu777
Copy link
Author

gugu777 commented Jun 12, 2024

Which exact script are you referring to? Is it cifar10_test_ood_sem.sh?

Also, by "paper" do you mean the v1 or v1.5 paper? A few datasets and methods presented in v1 are not considered in v1.5 (since v1.5 focuses more on the large-scale settings).

I am referring to the paper "Full Spectrum Out of Distribution Detection".

@zjysteven
Copy link
Collaborator

Then Jingkang might have better idea on that.

@Jingkang50
Copy link
Owner

The parameter used for MNIST should be -1, 0, 1.
The parameter for CIFAR should be smaller, like -0.01, 0, 1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants