Skip to content

Code for our ICCC'20 paper - "Feel The Music: Automatically Generating A Dance For An Input Song"

Notifications You must be signed in to change notification settings

purvaten/feel-the-music

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Feel The Music: Automatically Generating A Dance For An Input Song

This is the official repository accompanying the paper "Feel The Music: Automatically Generating A Dance For An Input Song", by Purva Tendulkar, Abhishek Das, Aniruddha Kembhavi & Devi Parikh.

Full text available at: https://arxiv.org/abs/2006.11905

Requirements

Create a new Python 3.7 virtual environment. Install the requirements using pip install -r requirements.txt

Steps for Generating Dances

  1. git clone https://github.com/purvaten/feel-the-music.git

  2. cd feel-the-music

  3. Generate dance (example below)

python generate_dance.py \
--songpath './audio_files/flutesong.mp3' \
--songname 'flutesong' \
--steps 100 \
--type "action" \
--visfolder './vis_num_steps_20/dancing_person_20'

A folder named plots will be created in the current directory containing frames of the dance and the final combined output as <songname>.mp4. The music and dance matrices will be saved as music.png and dance.png in the current directory.

NOTE : <visfolder> should contain GRID_SIZE number of images of the agent, smoothly transitioning into each other with the files numbered as 1.png, 2.png, ... <GRID_SIZE>.png. In our experiments GRID_SIZE=20.

Results

Song Type Number of Steps Agent Video
flutesong action 100 Stick figure Qries
Oe oe oe oa action 50 Stretchy leaves Qries
It's the time to disco (karaoke) action 100 Floating leaves Qries

For more examples, check https://sites.google.com/view/dancing-agents.

About

Code for our ICCC'20 paper - "Feel The Music: Automatically Generating A Dance For An Input Song"

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages