-
-
Notifications
You must be signed in to change notification settings - Fork 98
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Impl SaveToNpz for Optimizers #785
Comments
Related to #101 |
I think I have an approach that will work well for this:
|
4 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
On long training runs it's required to checkpoint models in case something goes wrong part way through. When only saving the model, and resetting the optimizer state, training takes much longer to resume. It would make sense therefore to save and load the optimizer as well. I believe this can be implemented with the same npz architecture as is currently implemented for TensorCollection modules.
The text was updated successfully, but these errors were encountered: