Skip to content

AudioCNN embedding extractor for connecting SAVI and HEAR.

License

Notifications You must be signed in to change notification settings

marl/hear-semav-embedding

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

23 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HEAR-SAVI

This module extracts an audio subnetwork from the upstream semantic audio-visual navigation (savi) model.

The embeddings implement the common API from HEAR Benchmark.

Requirements

  1. Install habitat-lab v0.2.1 and habitat-sim from commit 80f8e31140.
  2. pip install hear-savi
@inproceedings{chen20soundspaces,
  title     =     {SoundSpaces: Audio-Visual Navigaton in 3D Environments},
  author    =     {Changan Chen and Unnat Jain and Carl Schissler and Sebastia Vicenc Amengual Gari and Ziad Al-Halah and Vamsi Krishna Ithapu and Philip Robinson and Kristen Grauman},
  booktitle =     {ECCV},
  year      =     {2020}
}
```

About

AudioCNN embedding extractor for connecting SAVI and HEAR.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages