Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Phi-3 #148

Closed
Maskusa opened this issue May 4, 2024 · 9 comments
Closed

Add support for Phi-3 #148

Maskusa opened this issue May 4, 2024 · 9 comments
Labels
enhancement New feature or request

Comments

@Maskusa
Copy link

Maskusa commented May 4, 2024

Describe the feature

Add support for Phi-3 and Llama-3

@Maskusa Maskusa added the enhancement New feature or request label May 4, 2024
@amakropoulos
Copy link
Collaborator

Llama 3 support is implemented already in the latest version (v1.2.7).
I haven't tested yet phi3, will do that.

@amakropoulos amakropoulos changed the title Add support for Phi-3 and Llama-3 Add support for Phi-3 May 4, 2024
@Gabri94x
Copy link

hello there! any news? i tested and it was not supported in this version, i tried the new version of llama cpp and it run phi-3.
i tried to update the version on the plugin but without any result.

@amakropoulos
Copy link
Collaborator

hi, I'll look into it tomorrow!
I'll need to implement the phi-3 chat template as well.

@Gabri94x
Copy link

hello @amakropoulos, can you address me to understand how to add phi-3 support? i really need this to have this model works, i tested the native llamafile.cpp and it works well. if you can give some tips, i can make the implementation and share with the community :D

@amakropoulos
Copy link
Collaborator

Sorry for the huge delay, I was deep into some DLL issues for another PR.
I'll release it today!

@Gabri94x
Copy link

@amakropoulos i'm sorry, i did not mean to interfere with your work. let me know if i can help you in any way!
btw thanks a lot for all of your work, you are doing really great job!

@amakropoulos
Copy link
Collaborator

not at all, thanks for pinging :)!

@amakropoulos
Copy link
Collaborator

@Gabri94x @Maskusa phi-3 support is now integrated and released, thank you for your patience!

@Gabri94x
Copy link

@amakropoulos thank you for your work. really appreciated!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants