-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
UDOP - Fine tuning with bad metrics #420
Comments
Hi, Thanks for your interset in UDOP! Note that the metrics they show in the paper are for |
Hi @NielsRogge and thank you very much for your work! I have also tried to fine-tune the Can you give us any advice to improve these workouts? Wouldn't it be possible to achieve the results we saw in the paper with this notebook? |
I have obtained a finetune model in funds following the steps in your notebook, the only change introduced is the model base:
"microsoft/udop-large-512-300k"
Train configuration:
The results that I obtained in the end and the generated model have the following characteristics:
However, in the UDOP paper it is specified that the metrics of this model trained in FUNSD should be:
How can I reach those precision values?
Do you advise me to change any parameters of the model? Should I increase the number of epochs a lot?
Thank you so much
The text was updated successfully, but these errors were encountered: