New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Size mismatch, Error(s) in loading model finetuned by lora #1129
Comments
Something seems wrong with the vocab_size (which is the size of the embedding, not the actual vocabulary size) in config.json and the pad_to_multiple_of setting. Please try upgrade |
Okay, I upgrade transformers to 4.38.0, and use peft=0.7.0 now, but meet some errors which I haven't met when I use peft=0.9.0. config.json is here, I copied it from https://huggingface.co/Qwen/Qwen-7B-Chat/blob/main/config.json
|
There should be an adapter_config.json as well. Let's see what's there. I think peft is changing the vocab_size somewhere. |
This issue has been automatically marked as inactive due to lack of recent activity. Should you believe it remains unresolved and warrants attention, kindly leave a comment on this thread. |
Hi, have you solved this problem? |
I'm sorry I didn't follow up on this issue. |
是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
该问题是否在FAQ中有解答? | Is there an existing answer for this in FAQ?
当前行为 | Current Behavior
I finetune the QWen-7B, and when I use the finetuned model, I met some error:
I finetuned the model by use:
and I modified my cli-demo.py follow the tutorial:
I found some probably related issues like #419 #482 , but they can't solve my problem.
期望行为 | Expected Behavior
demo runs normally.
复现方法 | Steps To Reproduce
No response
运行环境 | Environment
备注 | Anything else?
No response
The text was updated successfully, but these errors were encountered: