Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

你好，看了你的视频受益良多，由个问题想请教。 #4

Open
kangkang-super-smart opened this issue Jul 3, 2019 · 1 comment
Open

你好，看了你的视频受益良多，由个问题想请教。 #4

kangkang-super-smart opened this issue Jul 3, 2019 · 1 comment

Comments

@kangkang-super-smart
Copy link

有什么方法可以解决词不在词向量词典中的预测问题呢，比如在预测时有词不在词典中，把它设为0，那这个词预测出来很大概率就是负向的了，
@aespresso
Copy link
Owner

把未知的词设为0, 0这个token指向的是“未知”的词, 所以和预测的结果并没有直接关系. 如果单纯说怎样解决未知词的问题, 1)需要扩充字典, 也就是扩充语料 2)用预训练语言模型提高模型性能. 最近我正在频道讲transformer语言模型的内容, 可以关注下

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kangkang-super-smart @aespresso