-
-
Notifications
You must be signed in to change notification settings - Fork 333
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Blitz tutorial takes too long to run (GD instead of SGD?) #336
Comments
But our mini-batches appear to not be so mini...the batch size is 1000! Fixing that should help. |
My bad, I was wrong on the meaning of a training epoch! Thanks for your answer, I will try reducing batch size |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi there!
In the 60-minute blitz tutorial (https://fluxml.ai/tutorials/2020/09/15/deep-learning-flux.html), the part where we train a network on CIFAR10 takes longer than expected. Could it be because we actually go through every minibatch in each epoch, instead of sampling only one?
I am specifically referring to this line
model-zoo/tutorials/60-minute-blitz/60-minute-blitz.jl
Line 366 in 52a7b89
The text was updated successfully, but these errors were encountered: