-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
<sft>llama3上下文支持好像有点问题 #422
Labels
Comments
你用的llama3么?是dashscope还是通过openaiapi的? |
我用的modelscope社区微信公众号文章(https://mp.weixin.qq.com/s/IuagQ-S_spbQRyVsJuFIkQ)里面训练好了的llama3-8B-Instruct-Agent模型,用的openaiapi |
之前训练的时候遇到过这个问题,我们也有过复现,8b上确实会存在这个问题,是模型能力的问题,我们接下来还会训练一个V2的版本,尽可能的在小模型上去掉这个问题。 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
Link
No response
The text was updated successfully, but these errors were encountered: