Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

我尝试着将math23k数据集加一些ape200k数据，但是出现了问题，请问这该如何解决？谢谢您 #29

Open
hejiaxingx opened this issue Feb 7, 2023 · 0 comments
Open

我尝试着将math23k数据集加一些ape200k数据，但是出现了问题，请问这该如何解决？谢谢您 #29

hejiaxingx opened this issue Feb 7, 2023 · 0 comments

Comments

@hejiaxingx
Copy link

因为ape200k的segmented_text是以字为粒度进行训练，我将ape200k测试集进行重新分词成math23k里的segmented_text格式，即以词为单位。如下图。然后将处理好格式的ape200k测试集数据加入到math23k测试集里。
image
但是这是错误提示：5V01GSU8Q@FS_134}Q~XJ
数据格式与math23k一致，试了几个算法模型都存在问题，不知问题所在，故请教
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@hejiaxingx