-
Notifications
You must be signed in to change notification settings - Fork 811
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Llama 3 based Gorilla #385
Comments
As per the https://github.com/ShishirPatil/gorilla/blob/main/inference/README.md , based on the Llama agreement, we will have to merge the Gorilla weights with the base Llama weights using the https://github.com/ShishirPatil/gorilla/blob/main/inference/apply_delta.py. As per Lllama 3 documentation here https://github.com/meta-llama/llama3, the weights are available in both native llama3 format and huggingface format. which should we be using for the apply_delta.py? Would the Gorilla Delta weights work with Llama 3 native weights? If at all we have all the above queries taken care of, should we be applying Gorilla delta on base Lllama model weights or Instruct based model weights? |
+1 to this question |
1 similar comment
+1 to this question |
Are there any plans to release Gorilla based on Llama 3? Is there any readme where we can find instructions on fine-tuning Llama 3 for Gorilla?
The text was updated successfully, but these errors were encountered: