-
Notifications
You must be signed in to change notification settings - Fork 239
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
BN layer weights and biases are not updated #77
Comments
Hi @kregmi , I am not maintaining this repo but I am also using this implementation. I trained BYOL and did not experience this issue. I am not sure why it happened to you. Are you sure you saved the network correctly? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Thanks for sharing this repo, great work!
I trained BYOL on my data and noticed that the weights and biases for BN layers are not updated on the saved model. I used resnet18 without pretrained weights
resnet = models.resnet50(pretrained=False)
. After training for multiple epochs, the saved model hasbn1.weight
all equal to 1.0 andbn1.bias
all equal to 0.0 .Is this the expected behavior or am I missing something? Appreciate your response!
The text was updated successfully, but these errors were encountered: