Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请教下有gpt2的微调的相关文档么? #353

Open
ucas010 opened this issue Feb 13, 2023 · 2 comments
Open

请教下有gpt2的微调的相关文档么? #353

ucas010 opened this issue Feb 13, 2023 · 2 comments

Comments

@ucas010
Copy link

ucas010 commented Feb 13, 2023

hi大佬
gpt2-chinese,我看了,但是没有相关微调的代码,在此看到了如下代码,但是数据格式没有告知,也不知道是不是纯文本,

python3 preprocess.py --corpus_path corpora/cluecorpussmall.txt \
                      --vocab_path models/google_zh_vocab.txt \
                      --dataset_path cluecorpussmall_lm_seq128_dataset.pt \
                      --seq_length 128 --processes_num 32 --data_processor lm

请教下这个是微调的代码么?

@terminator123
Copy link

请问你解决了吗

@hahazei
Copy link

hahazei commented Jul 5, 2023

同问,没有格式,不知道怎么准备语料

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants