Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?
-
Updated
Mar 27, 2023 - C
Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)
This repository includes the official implementation of our paper "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks
✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models. The first work to correct hallucinations in MLLMs.
🤖A list of PaperList of NLP related papers on Github
🖼️Latest Papers on Visually(Imagination)-Augmented NLP
mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating
A Video Chat Agent with Temporal Prior
Awesome list for attacks on large language models.
MIKO: Multimodal Intention Knowledge Distillation from Large Language Models for Social-Media Commonsense Discover
A collection of visual instruction tuning datasets.
[CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection
Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception
Code for the MultipanelVQA benchmark "Muffin or Chihuahua? Challenging Large Vision-Language Models with Multipanel VQA"
Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context learning, visual reasoning, foundational models, and more. Stay updated with the latest advancement.
[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"
Unified Multi-modal IAA Baseline and Benchmark
Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
Add a description, image, and links to the mllm topic page so that developers can more easily learn about it.
To associate your repository with the mllm topic, visit your repo's landing page and select "manage topics."