-
Notifications
You must be signed in to change notification settings - Fork 67
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Vectorial representation, particular of multiscale STFT #66
Comments
Totally. So you would like an interface to pass an audio file (or batch) and return the multi-res STFT representation? |
Correct! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
With the rise of fast vector databases for doing approximate nearest neighbors (FLANN, annoy, chroma, milvius, weaviate, etc.), it becomes increasingly useful to have vectorial representations of audio for exploring large corpora.
For something like l1 distance over log-mels, e.g. in hifigan, it is relatively straightforward to get the vector representation of audio without the need for a library like auraloss: https://github.com/jik876/hifi-gan/blob/master/meldataset.py
However, for doing l2 distance of a multiscale STFT representation, it can be relatively tricky to make sure that all different STFT scales are correctly normalized and the code is correct. For that reason, it would be amazing to have an interface for retrieving the vectorial multiscale STFT representation of audio that can be easily and directly used in a vector database.
The text was updated successfully, but these errors were encountered: