Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

what is the setting of the param :DOUBLE_BIAS and WEIGHT_DECAY #13

Open
Usernamezhx opened this issue Dec 7, 2018 · 4 comments
Open

Comments

@Usernamezhx
Copy link

First of all. thanks for your code. I don't know the setting about hte param : DOUBLE_BIAS and WEIGHT_DECAY . it show me that:

[epoch 0][iter 10] loss: nan RMSElog: nan grad_loss: nan normal_loss: nan
[epoch 0][iter 20] loss: nan RMSElog: nan grad_loss: nan normal_loss: nan
[epoch 0][iter 30] loss: nan RMSElog: nan grad_loss: nan normal_loss: nan
[epoch 0][iter 40] loss: nan RMSElog: nan grad_loss: nan normal_loss: nan
[epoch 0][iter 50] loss: nan RMSElog: nan grad_loss: nan normal_loss: nan
[epoch 0][iter 60] loss: nan RMSElog: nan grad_loss: nan normal_loss: nan
[epoch 0][iter 70] loss: nan RMSElog: nan grad_loss: nan normal_loss: nan

@Usernamezhx
Copy link
Author

I find the depth loss is inf.

@Usernamezhx
Copy link
Author

I find the question. because I use my own data. and the data has some zero value .So when I use the torch.log function. it will produce the inf value.

@Haiyan-Chris-Wang
Copy link

what number you set about the DOUBLE_BIAS and WEIGHT_DECAY?

1 similar comment
@vinojhosan
Copy link

what number you set about the DOUBLE_BIAS and WEIGHT_DECAY?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants