Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fine tuning support #102

Open
GUUser91 opened this issue Aug 5, 2023 · 3 comments
Open

Fine tuning support #102

GUUser91 opened this issue Aug 5, 2023 · 3 comments

Comments

@GUUser91
Copy link

GUUser91 commented Aug 5, 2023

This fork of bark includes fine tuning support. Can you add this feature in?
https://github.com/serp-ai/bark-with-voice-clone

@matbee-eth
Copy link

training doesnt work because suno wont release the weights

@JonathanFly
Copy link
Owner

JonathanFly commented Sep 4, 2023

I have tested that fine-tuning just briefly. It's challenging to get it just right. I'm for sure going to have something along those those lines. You're going to be able to use large samples of voice sample and do fun things with them. I've had more luck combining very long inferencing with very light fine-tuning, then the fine-tuning by itself.

I know I haven't updated Bark Infinity forever, but it's not dead. I've have been adding to my local fork as I try out experiments. The problem is the endless experimentation made using the code for 'real work' difficult or even broken and cleaning it up is going to take a while. I have to just bypass most of my own code to test against default Bark quite often because my sampling is so convoluted. I also want to move over the Hugging Face Bark implementation but that's turning out to be more challenging than I expected with all my custom changes, and understanding how to port everything over to their conventions and API is going to take me awhile to wrap my head around.

I don't know if anyone else cares, but finally, full colored terminal output. Useful? No. But it just makes my day better.

console_1
console_2

If I had to guess it'd be still 3 weeks till I update, pretty busy with regular work too.

@platform-kit
Copy link

@JonathanFly did you ever make any progress with the fine-tuning script?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants