Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

UniMC对于选项位置敏感的问题 #437

Open
shuopwang opened this issue Oct 30, 2023 · 0 comments
Open

UniMC对于选项位置敏感的问题 #437

shuopwang opened this issue Oct 30, 2023 · 0 comments

Comments

@shuopwang
Copy link

在自己数据库中继续微调UniMC时，为了防止模型过拟合，只记住数据中占多数的选项的位置，所以特意在构造数据时打乱了对应选项choice的位置。
数据集规模：4k
微调后发现，同样的输入，调整不同的选项位置后，造成预测的答案分布不一致。

请问这样的情况，之前是否有遇到，如果遇到有什么比较合适的解决方案吗？
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@shuopwang