You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This issue has been created to track that the following text metrics have been temporarily disabled because they are expensive to compute:
BLEU
ROUGE
WordErrorRate
CharacterErrorRate
We can re-enable them at a different time by allowing users to customize which metrics they want to see during training, leaving the onus on the user to decide how much extra time they are willing to spend training to get more training metrics.
For reference, this is how BLEU and ROUGE scale with a sample of 200 rows over different sequence lengths:
The text was updated successfully, but these errors were encountered:
This issue has been created to track that the following text metrics have been temporarily disabled because they are expensive to compute:
We can re-enable them at a different time by allowing users to customize which metrics they want to see during training, leaving the onus on the user to decide how much extra time they are willing to spend training to get more training metrics.
For reference, this is how BLEU and ROUGE scale with a sample of 200 rows over different sequence lengths:
The text was updated successfully, but these errors were encountered: