Add support for Video-LLaVA #5661
psychodinae
started this conversation in
Ideas
Replies: 1 comment
-
+1 I tried to use the LLaVA image encoder converter in the examples and it doesn't seem to work since Video-LLaVA doesn't generate the I looked and found this line:
Not sure if its failing to see the video_tower and image_tower tensors... |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
https://github.com/PKU-YuanGroup/Video-LLaVA
https://huggingface.co/spaces/LanguageBind/Video-LLaVA
What sort of black magic is this? Is it possible to implement as in LLaVA 1.5?
An GGUF version of this would be amazing.
Beta Was this translation helpful? Give feedback.
All reactions