Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Can we suport qwen series? #436

Open
zhangfan-algo opened this issue May 8, 2024 · 5 comments
Open

Can we suport qwen series? #436

zhangfan-algo opened this issue May 8, 2024 · 5 comments
Labels
fixed - pending confirmation Fixed, waiting for confirmation from poster

Comments

@zhangfan-algo
Copy link

No description provided.

@erwe324
Copy link

erwe324 commented May 8, 2024

Llamafied Qwen models can be directly loaded

@zhangfan-algo
Copy link
Author

Can you provide a script for converting the format?

@erwe324
Copy link

erwe324 commented May 8, 2024

Some of the previous issues on the same topic have them.
As for the model, you can search hugging face for qwen llamafied keywords.

@danielhanchen
Copy link
Contributor

Oh I think someone made a PR for Qwen

@danielhanchen
Copy link
Contributor

It should be supported everyone! @zhangfan-algo @erwe324! If you're on a local machine, please update Unsloth via

pip uninstall unsloth -y
pip install --upgrade --force-reinstall --no-cache-dir git+https://github.com/unslothai/unsloth.git

Colab and Kaggle is fine (just restart it)

@danielhanchen danielhanchen added the fixed - pending confirmation Fixed, waiting for confirmation from poster label May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
fixed - pending confirmation Fixed, waiting for confirmation from poster
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@danielhanchen @zhangfan-algo @erwe324