Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] 一个把internLM2 LoRA部分转换成llama风格的脚本 #737

Open
1 task
ChengYouFancy opened this issue May 8, 2024 · 1 comment
Open
1 task
Labels
enhancement New feature or request

Comments

@ChengYouFancy
Copy link

Describe the feature

为了解决多任务之间可能互相影响的问题,现在有一个成熟可用的基于LoRA路由的技术方案,详见https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples/llama#run-llama-with-several-lora-checkpoints。
因此,需要将internLM2 LoRA部分转换成llama风格

Will you implement it?

  • I would like to implement this feature and create a PR!
@ChengYouFancy ChengYouFancy added the enhancement New feature or request label May 8, 2024
@puffy310
Copy link

InternLM2 has already been Llamafied. https://huggingface.co/KnutJaegersberg/internlm-20b-llama/
This should hopefully be able to do what you need it to do.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants