New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

使用ArcLoss时loss值nan？ #37

Open

Harry-675 opened this issue Mar 23, 2020 · 1 comment

Harry-675 commented Mar 23, 2020

您好，感谢您的工作，最近训练模型时用到了arcloss，得到的loss值是nan，请问您有遇到这个问题吗？另外cosloss看代码实现没有看到跟余弦、正弦相关的计算，这个感觉跟定义不太一样。希望能得到您的解答！

Contributor

haoxintong commented Mar 25, 2020

arcloss 初期训练不稳定，可以先softmax预训练，然后finetune。

cosloss 论文中的定义是这样的，不需要计算cos/sin

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment