Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chatglm_v2_6b_lora多卡如何设置，没有找到 #162

Open
BQQQQB opened this issue Nov 20, 2023 · 2 comments
Open

chatglm_v2_6b_lora多卡如何设置，没有找到 #162

BQQQQB opened this issue Nov 20, 2023 · 2 comments

Comments

@BQQQQB
Copy link

BQQQQB commented Nov 20, 2023

chatglm_v2_6b_lora多卡如何设置，没有找到
@BQQQQB BQQQQB changed the title chatglm2 chatglm_v2_6b_lora多卡如何设置，没有找到 Nov 20, 2023
@enzocxt
Copy link

enzocxt commented Mar 17, 2024

同问，我也没找到，多卡就报错

@yuanzhoulvpi2017
Copy link
Owner

现在建议使用deepspeed来训练吧（这个支持多卡训练）。不建议使用模型并行来训练了。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@enzocxt @yuanzhoulvpi2017 @BQQQQB