-
-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
spancat training not working with span group other than "sc" #13090
Comments
Hi @nrodnova, thanks for reporting this! We'll look into it. |
This is likely due to your score weights not being configured properly, as the name of the score weight attributes are derived from the value of [training.score_weights]
spans_sc_f = 1.0
spans_sc_p = 0.0
spans_sc_r = 0.0 I recommend adding your config to include this snippet (or update it if it's already in there) with score weights that reflect your actual [training.score_weights]
spans_myspankey_f = 1.0
spans_myspankey_p = 0.0
spans_myspankey_r = 0.0 |
@rmitsch Thanks that makes sense. I will test it out and comment back. If this works, it would be nice to add it to the documentation. |
How to reproduce the behaviour
When
span_key
in[components.spancat_singlelabel]
or[components.spancat]
sections is other than"sc"
, training output looks like this:I thought I was getting insane :)
Seems like a bug at the evaluation step, I didn't investigate further, sorry.
Other parts seem to be working:
is happy with non-"sc" value.
Also, the labels get picked up from the training dataset and show up correctly in
meta.json
.After I changed
span_key
back to the default "sc", I got this:Also, not sure why sentence metrics show up - I am using non-trainable simple sentencizer. It's not that important, obviously.
Your Environment
The text was updated successfully, but these errors were encountered: