-
Notifications
You must be signed in to change notification settings - Fork 80
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Question: How long should saving the checkpoint take? #64
Comments
edit: it does finish it, but it takes 2 whole hours to save the checkpoints. Is this normal behaviour? |
That is preparing the test data. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
When the checkpoint is saved while training, how long should this process take? It seems to me that my program doesn't run at the point of saving.
In the image I set the checkpoint saving threshold to 10 for testing purposes.
The text was updated successfully, but these errors were encountered: