New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Inappropriate saving of the merged fine tuned llama-2 model #3931
Comments
Hi @raghavbj24 -- thank you for submitting this issue! Question for you: I see that your |
Hi @alexsherstinsky-- as per your suggestion I tried the base model as |
@raghavbj24 Could you please point me to the HuggingFace location where your model is saved and enable me to access it with "read" privileges? I am going to look into it thoroughly in the next few days. Thank you. |
@raghavbj24 In parallel, if you do not mind: could you please rerun your experiment using this base model: |
Hi,
I am trying to fine tune the llama-2 model with the help of the following config file->
The fine tuning is successful and I can see that merge and unload process was also completed as shown->
When I checked the disk size for this saved model it was 7.6MB only...indicating that the merge did not happen appropriately.
Environment:
Can someone help me in solving this
TIA
The text was updated successfully, but these errors were encountered: