-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
PeftModel failing to load after finetuning. Size Mismatch Error #1710
Comments
my error is similar like this one |
It looks like empty weights were stored when you saved your checkpoint after DeepSpeed training. Probably if you check the size if the file, you'll find it to be smaller than expected. If you follow our DeepSpeed guide, you should get working results. |
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread. |
System Info
I trained the
Mistral-7B-Instruct-v0-1
model using LoRa and deepspeedCode to load model after fine-tuning:
Deepspeed config:
I am getting the following error:
Who can help?
@younesbelkada @BenjaminBossa
Information
Tasks
examples
folderReproduction
Code to load model during fine-tuning:
Expected behavior
Weights should load as expected.
The text was updated successfully, but these errors were encountered: