-
Notifications
You must be signed in to change notification settings - Fork 384
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
使用 fp16 训练,merge lora 之后的模型推理结果异常 #456
Comments
异常报错截图 |
没有报错,是推理结果不对,没merge结果是对的,但是merge完推理的结果都是[][][][][][]... |
两个都能正常输出结果,但是上面的结果是正确的,但是下面的结果就是错的?请问一下是什么原因 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
System Info / 系統信息
版本及硬件按照指示安装
Who can help? / 谁可以帮助到您?
@1049451037
Information / 问题信息
Reproduction / 复现过程
Expected behavior / 期待表现
怀疑是 fp16 训练的模型,merge 过程中存在bug,能不能帮忙定位一下问题
The text was updated successfully, but these errors were encountered: