ms-swift: Use PEFT or Full-parameter to finetune 200+ LLMs or 15+ MLLMs

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

日本語LLMまとめ - Overview of Japanese LLMs

Official code for Paper "Mantis: Multi-Image Instruction Tuning"

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

Running Gen AI models and applications on NVIDIA Jetson devices with one-line command

Real-Time Multimodal Pipelines for GenAI

Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Real World Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD

autoupdate paper list

VT.ai - Multi-modal AI Chatbot Assistant

Implementation for the different ML tasks on Kaggle platform with GPUs.

A web UI Project In order to learn the large language model. This project includes features such as chat, quantization, fine-tuning, prompt engineering templates, and multimodality.

Build and explore multimodal web interactives with pieces of paper!

Open-source simulation engine for robotic general intelligence (RGI)

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

CSCI2470 Deep Learning Spring 2024: Enhancing Out-of-Distribution Object Detection with CLIP: A Vision-Language Approach

Stable Diffusion and LLMs offline on your own hardware

Visualize streams of multimodal data. Fast, easy to use, and simple to integrate. Built in Rust using egui.

Data Infrastructure for Multimodal AI: Data, models, and orchestration in a unified declarative interface.