[CVPR 2024] 🎬💭 chat with over 10K frames of video!
-
Updated
May 24, 2024 - Python
[CVPR 2024] 🎬💭 chat with over 10K frames of video!
up-to-date and curated list of awesome state-of-the-art LVLMs hallucinations research work, papers & resources
Speech, Language, Audio, Music Processing with Large Language Model
Simulating Large-Scale Multi-Agent Interactions with Limited Multimodal Senses and Physical Needs
mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding
FreeVA: Offline MLLM as Training-Free Video Assistant
A curated list of awesome Multimodal studies.
Curated papers on Large Language Models in Healthcare and Medical domain
Multimodal RAG and comparisons between language models. (Project for Deep Learning Module at the FHSWF)
UMBRAE: Unified Multimodal Decoding of Brain Signals | Unveiling the 'Dark Side' of Brain Modality
✨✨Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.
This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
Personal Project: MPP-Qwen14B(Multimodal Pipeline Parallel-Qwen14B). Don't let the poverty limit your imagination! Train your own 14B LLaVA-like MLLM on RTX3090/4090 24GB.
A framework streamlining Training, Finetuning, Evaluation and Deployment of Multi Modal Language models
[ACL 2024] An Easy-to-use Hallucination Detection Framework for LLMs.
Voice assistant using Multimodal LLMs - LLaVA-NeXT (Mistral 7B) finetuned & PhoWhisper
[Arxiv 2024] Official Implementation of the paper: "InstrAug: Automatic Instruction Augmentation for Multimodal Instruction Fine-tuning"
Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
Add a description, image, and links to the multimodal-large-language-models topic page so that developers can more easily learn about it.
To associate your repository with the multimodal-large-language-models topic, visit your repo's landing page and select "manage topics."