New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

参见《zero-lora零训练llm调参算法》，思路差不多 #8

Open

ziwang-com opened this issue May 17, 2023 · 0 comments

ziwang-com commented May 17, 2023

zero-lora零训练llm调参算法
https://github.com/ziwang-com/zero-lora

工程案例参见：全球首个StableVicuna中文优化版。

https://github.com/ziwang-com/chinese-StableVicuna

整个项目，仅用半天时间，其中大部分时间花在格式转换方面，与zero-lora相关的环节，不到20%。

zero-loro零训练llm调参算法，属于zw团队在llm一线工程中，总结的实战算法，相关理论，正在摸索当中，欢迎llm领域的专家学者，共同探讨。

ziwang-com changed the title ~~参见zero-lora，思路差不多~~ 参见《zero-lora零训练llm调参算法》，思路差不多

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment