Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

支持Stable Diffusion API或者ComfyUI、FooocusAPI等可以生成图片,嵌入故事 #179

Open
GentlemanHu opened this issue Apr 6, 2024 · 8 comments
Labels
enhancement New feature or request

Comments

@GentlemanHu
Copy link

支持Stable Diffusion API或者ComfyUI、FooocusAPI等用模型生成图片,嵌入故事

https://github.com/lllyasviel/Fooocus
https://github.com/comfyanonymous/ComfyUI

_captioned_gentle_20240125050849932031.mp4
@harry0703
Copy link
Owner

非常赞👍🏻

@harry0703 harry0703 added the enhancement New feature or request label Apr 6, 2024
@youngphp
Copy link

youngphp commented Apr 8, 2024

支持Stable Diffusion API或者ComfyUI、FooocusAPI等用模型生成图片,嵌入故事

https://github.com/lllyasviel/Fooocus https://github.com/comfyanonymous/ComfyUI

_captioned_gentle_20240125050849932031.mp4

老哥这个视频 怎么生成的

@youngphp
Copy link

youngphp commented Apr 8, 2024

非常赞👍🏻

大佬 上面老哥的那个建议 有排期么 挺期待的 - -

@normal-ai
Copy link
Contributor

这个好,期待支持

@GentlemanHu
Copy link
Author

支持Stable Diffusion API或者ComfyUI、FooocusAPI等用模型生成图片,嵌入故事
https://github.com/lllyasviel/Fooocus https://github.com/comfyanonymous/ComfyUI
_captioned_gentle_20240125050849932031.mp4

老哥这个视频 怎么生成的

ComfyUI做的,用了几个自定义节点,gpt生故事 ->gpt分段(tts生语音)->分段给gpt生成stable diffusion的prompt -> 生图片 -> 音视频合成

期待大佬做更好的效果,更好的运镜,字幕效果

@GentlemanHu
Copy link
Author

找到几个关于视频剪辑合成的库看能否用到:

https://github.com/rezoo/movis
https://github.com/remotion-dev/remotion

carbonized-vertical-30fps-540x960

@dwgeneral
Copy link

支持Stable Diffusion API或者ComfyUI、FooocusAPI等用模型生成图片,嵌入故事
https://github.com/lllyasviel/Fooocus https://github.com/comfyanonymous/ComfyUI
_captioned_gentle_20240125050849932031.mp4

老哥这个视频 怎么生成的

ComfyUI做的,用了几个自定义节点,gpt生故事 ->gpt分段(tts生语音)->分段给gpt生成stable diffusion的prompt -> 生图片 -> 音视频合成

期待大佬做更好的效果,更好的运镜,字幕效果

字幕生成也有现成的 ComfyUI 自定义节点吗?

@GentlemanHu
Copy link
Author

支持Stable Diffusion API或者ComfyUI、FooocusAPI等用模型生成图片,嵌入故事
https://github.com/lllyasviel/Fooocus https://github.com/comfyanonymous/ComfyUI
_captioned_gentle_20240125050849932031.mp4

老哥这个视频 怎么生成的

ComfyUI做的,用了几个自定义节点,gpt生故事 ->gpt分段(tts生语音)->分段给gpt生成stable diffusion的prompt -> 生图片 -> 音视频合成
期待大佬做更好的效果,更好的运镜,字幕效果

字幕生成也有现成的 ComfyUI 自定义节点吗?

https://github.com/yuvraj108c/ComfyUI-Whisper.git

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants