Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

zero finetuning思路有问题 #6

Open
Doraemon20190612 opened this issue Apr 20, 2023 · 1 comment
Open

zero finetuning思路有问题 #6

Doraemon20190612 opened this issue Apr 20, 2023 · 1 comment

Comments

@Doraemon20190612
Copy link

看了代码,本质上模型没有任何更新,你的学习前,学习中和学习后的区别就是prompt发生了变化。其实模型没有学到任何东西。

@StarRing2022
Copy link
Owner

感谢您的细心检查!正如说的这样,zero finetuning意为零次微调,因而权值是不会更新的,但这样做也是有好处的,此时将不断更新的prompt形成到本地的一个JSON文件中,就相当于是一个动态变化的知识数据库。就像人类一样,当资源充足时,才会对整体模型进行一次微调。由于这段时间忙于研究,这一部分说明后续加上。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants