Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Support SD Video (SVD-xt) #237

Open
1 task done
nickmitchko opened this issue Nov 23, 2023 · 0 comments
Open
1 task done

[Feature Request]: Support SD Video (SVD-xt) #237

nickmitchko opened this issue Nov 23, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@nickmitchko
Copy link

Is there an existing issue for this?

  • I have searched the existing issues and checked the recent builds/commits

What would your feature do ?

I would like to request a feature that supports the new Stable Video Diffusion model, which can be found at this link: https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt. This new model represents a significant advancement in generative video technology and has the potential to greatly enhance the user experience.

The feature extension should include the following capabilities:

  1. Ability to specify the number of frames: Users should be able to choose the desired number of frames in the generated video, allowing them to control the length and detail of the output.
  2. Adjustable resolution: Provide the option to select the resolution of the generated video, giving users more control over the quality and file size of the output.
  3. Upload pane for source image: Incorporate an upload pane for a source image, which can be used as a reference for the video model. This will enable users to easily input their desired image and create a video based on it.
  4. . Integration with img2txt tab: Add a button that allows users to seamlessly pull images from the img2txt tab within the application, streamlining the process of creating a video from an existing image.

For reference, the sample code can be found at this link: https://github.com/Stability-AI/generative-models. I have lots of VRAM, would be happy to test.

Thank you for considering this feature request, and I look forward to the continued development and improvement of the sd-webui-text2video extension.

Proposed workflow

  1. Press [txt2video]
  2. Add Model Type [SVD-xt]
  3. Inherit the same settings as the txt2vid sub tab.

Additional information

No response

@nickmitchko nickmitchko added the enhancement New feature or request label Nov 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant