Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demonstration Use Case #55

Open
Omarch47 opened this issue Apr 29, 2024 · 4 comments
Open

Demonstration Use Case #55

Omarch47 opened this issue Apr 29, 2024 · 4 comments

Comments

@Omarch47
Copy link

Hello, I recently came across this repo while looking for Suno API access and was very happy to find this. I wanted to use Suno to have my robots generate songs based off a prompt you speak to them. I wanted to share the process here to show some of the possibilities that this has been used for. I posted a video outlining the process here: https://youtu.be/hBqjj34e9x0

Thanks for the excellent work!

@blueeon
Copy link
Contributor

blueeon commented Apr 29, 2024

Thanks for the video, your work is so freaking awesome.

@Omarch47
Copy link
Author

As is yours, I appreciate the kind words!

@tob-har
Copy link

tob-har commented Apr 30, 2024

Great work!!
... you could implement a second cycle and do audio track separation for example via lala.ai.
It works great and also can be called via API. Then you could just separate vocals from rest, play back both files in sync and only use the vocal part for your lip-Sync animation as it seems to be audio-reactive to the volume. What do you think about that? Cheers and looking forward if you create a spooky robot face choir or so one day ;-)

@Omarch47
Copy link
Author

Omarch47 commented May 3, 2024

Great work!! ... you could implement a second cycle and do audio track separation for example via lala.ai. It works great and also can be called via API. Then you could just separate vocals from rest, play back both files in sync and only use the vocal part for your lip-Sync animation as it seems to be audio-reactive to the volume. What do you think about that? Cheers and looking forward if you create a spooky robot face choir or so one day ;-)

Thanks very much! That is a very good idea. I have a separate mouth system that generates mouth sprites based on input strings so I may also try to parse the returned lyrics from this api and try to have them spoken while the music is playing. Getting them to sync well would be the biggest challenge I believe!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants