New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[友情链接] <Colossal-AI加速ChatGLM2> #663

Open

Yanjia0 opened this issue Feb 7, 2024 · 0 comments

Yanjia0 commented Feb 7, 2024

Is your feature request related to a problem? Please describe.

No response

Solutions

Colossal-AI的shardformer模型可以自动切分ChatGLM2，并使用后续一系列并行与内存异构方法对其进行训练加速。非常感谢您能在友情链接中加入我们的开源仓库https://github.com/hpcaitech/ColossalAI,并在requirements.txt对colossalai进行声明。
谢谢！

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment