Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding spoken dialogue state tracking recipes for Spoken MultiWoz and SpokenWoz datasets #2424

Open
wants to merge 53 commits into
base: develop
Choose a base branch
from
Open

Adding spoken dialogue state tracking recipes for Spoken MultiWoz and SpokenWoz datasets #2424

wants to merge 53 commits into from

Commits on Apr 16, 2024

  1. WIP: Adding spoken dialogue state tracking. To be tested.

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    f97e515 View commit details
    Browse the repository at this point in the history

  2. WIP: Changed augmentation and updated gradient check

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    5f04c12 View commit details
    Browse the repository at this point in the history

  3. WIP: Changing augmentation method and typos

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    e7c2219 View commit details
    Browse the repository at this point in the history

  4. WIP: Updating the fetch method for import of model

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    86f0283 View commit details
    Browse the repository at this point in the history

  5. WIP: Making the evaluation script common to both datasets

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    aec1030 View commit details
    Browse the repository at this point in the history

  6. FIX: the decoder expects ints as input ids while the memory returns f… 

    …loats
    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    7acb781 View commit details
    Browse the repository at this point in the history

  7. WIP: Removing logging of logprobs bc obtained from teacher forcing an… 

    …d not searcher
    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    fa44284 View commit details
    Browse the repository at this point in the history

  8. FIX: Removing check_gradients which returned all parameters at None

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    3a1ff58 View commit details
    Browse the repository at this point in the history

  9. FIX: Removing unnecessary parameters

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    9268404 View commit details
    Browse the repository at this point in the history

  10. FIX: Updating resampler and testsplit processing

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    20bb39c View commit details
    Browse the repository at this point in the history

  11. FIX: Issue with searcher removing last token --> seq2seq fix coming

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    c394b05 View commit details
    Browse the repository at this point in the history

  12. FIX: The lengths already account from removing the EOS token

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    4d10e58 View commit details
    Browse the repository at this point in the history

  13. Updating headers

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    0b3dd0f View commit details
    Browse the repository at this point in the history

  14. FIX: Resampling only the needed dialogue turn instead of the whole di… 

    …alogue
    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    e59abfd View commit details
    Browse the repository at this point in the history

  15. FIX: Uniformising yamls

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    7037110 View commit details
    Browse the repository at this point in the history

  16. FIX: Adding file name to SpokenWoz reports

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    4cd1996 View commit details
    Browse the repository at this point in the history

  17. Cleaned READMEs and models

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    0546257 View commit details
    Browse the repository at this point in the history

  18. Ran black over code

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    7989b56 View commit details
    Browse the repository at this point in the history

  19. Corrected README

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    3d758cb View commit details
    Browse the repository at this point in the history

  20. FIX: Refactoring data preparation for flake8

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    077f872 View commit details
    Browse the repository at this point in the history

  21. FIX: Switching to new huggingface models interface

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    2420c2e View commit details
    Browse the repository at this point in the history

  22. FIX: reducing complexity by adding an intermediary function

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    2b7963e View commit details
    Browse the repository at this point in the history

  23. FIX: Removing trailing whitespaces

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    5838ebd View commit details
    Browse the repository at this point in the history

  24. FIX: Adding one test for each recipes

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    3f04c58 View commit details
    Browse the repository at this point in the history

  25. FIX: Adding test for other yaml files, there needs to be one per yaml… 

    … file
    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    d53b202 View commit details
    Browse the repository at this point in the history

  26. FIX: Adding missing docstrings

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    e49dc32 View commit details
    Browse the repository at this point in the history

  27. Avoid loading the entire file in MultiWOZ data prep

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    b112c3f View commit details
    Browse the repository at this point in the history

  28. Some cleanups in multiWOZ data prep

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    50d64b9 View commit details
    Browse the repository at this point in the history

  29. Merge run+model to train.py in MultiWOZ

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    3697c35 View commit details
    Browse the repository at this point in the history

  30. Rename multiwoz_prepare_slu to multioz_dstc11_prepare

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    30f424a View commit details
    Browse the repository at this point in the history

  31. Crash MultiWOZ training if not fp32

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    ad6e02e View commit details
    Browse the repository at this point in the history

  32. Added missing extra_requirements.py for MultiWOZ

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    d5442e4 View commit details
    Browse the repository at this point in the history

  33. data/->meta/ + rename + remove test_manifest.txt from repo 

    Still need a further commit to download the test_manifest from dropbox once
I can reupload it.
The dataset download script was removed and merged into the README as we
always avoid having shell scripts in the repo (might be worth simplifying
the steps down the line and avoid the destructive renames etc.).
The extract_audio script was renamed to explicitly refer to the DSTC11 version.
    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    74afc3b View commit details
    Browse the repository at this point in the history

  34. Fixed broken table formatting for GitHub

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    e6826fb View commit details
    Browse the repository at this point in the history

  35. Make it more obvious what the title of the table is

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    75e392b View commit details
    Browse the repository at this point in the history

  36. Update link to test manifest

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    c3c9852 View commit details
    Browse the repository at this point in the history

  37. Move spokenwoz prepare script + move instructions to README + README … 

    …fixes
    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    4b259b5 View commit details
    Browse the repository at this point in the history

  38. Merge run+model into train.py for SpokenWoz

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    374a62e View commit details
    Browse the repository at this point in the history

  39. Rename SpokenWoz to SpokenWOZ

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    5226ea1 View commit details
    Browse the repository at this point in the history

  40. typo

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    d2e89d6 View commit details
    Browse the repository at this point in the history

  41. Update recipe script name too

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    17aff14 View commit details
    Browse the repository at this point in the history

  42. Add fp32 check to spokenWOZ as well

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    aa63d2c View commit details
    Browse the repository at this point in the history

  43. Remove unused activation keys from yaml

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    ca2b8be View commit details
    Browse the repository at this point in the history

  44. Fix recipe test path again

    @asumagic @LucasDruart
    asumagic authored and LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    6509ed9 View commit details
    Browse the repository at this point in the history

  45. Moving JGATracker to metrics_stats.py and dataset specific parts of e… 

    …valuation script in each recipe
    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    8f2c55d View commit details
    Browse the repository at this point in the history

  46. Moving evaluation of recipes to meta folders

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    85055eb View commit details
    Browse the repository at this point in the history

  47. Codespell for singe ==> single

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    433af3b View commit details
    Browse the repository at this point in the history

  48. Updating pre-commit pipeline

    @LucasDruart
    LucasDruart committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    5476fda View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. Merge branch 'develop' into dialogue_state_tracking

    @asumagic
    asumagic committed May 2, 2024
    Configuration menu
    Copy the full SHA
    64547a4 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. Merge branch 'speechbrain:develop' into dialogue_state_tracking

    @LucasDruart
    LucasDruart committed May 6, 2024
    Configuration menu
    Copy the full SHA
    16755ba View commit details
    Browse the repository at this point in the history

  2. Fix: Doctring correction and code cleaning

    @LucasDruart
    LucasDruart committed May 6, 2024
    Configuration menu
    Copy the full SHA
    19f845d View commit details
    Browse the repository at this point in the history

  3. Merge branch 'dialogue_state_tracking' of https://github.com/LucasDru… 

    …art/speechbrain into dialogue_state_tracking
    @LucasDruart
    LucasDruart committed May 6, 2024
    Configuration menu
    Copy the full SHA
    9d6e96d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'dialogue_state_tracking' of https://github.com/LucasDru… 

    …art/speechbrain into dialogue_state_tracking
    @LucasDruart
    LucasDruart committed May 6, 2024
    Configuration menu
    Copy the full SHA
    dd3eb77 View commit details
    Browse the repository at this point in the history