-
Notifications
You must be signed in to change notification settings - Fork 490
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Explaining train-validation-test split in M3 #439
Comments
This was referenced Aug 19, 2021
ArturoAmorQ
changed the title
Explaining special case of nested-CV in M3
Explaining train-validation-test split in M3
Aug 26, 2021
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The first time we use a train-validation-test split for parameter tuning is at the beginning of M3 in this exercise, as we (silently) use CV within the training set and then we score the model in a fixed test set (as in this figure).
Nowadays we explain this concept, as well as nested cross-validation, in the Evaluation and hyperparameter tuning notebook. But it would be better if we had a video to dynamically show the swapping folds in the train-validation set, similar to the Validation of a model video.
See also #755.
The text was updated successfully, but these errors were encountered: