LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DPO & LoRA & Mixtral)

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

An Open-sourced Knowledgable Large Language Model Framework.

Best practice for training LLaMA models in Megatron-LM

Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

Large Language Models for All, 🦙 Cult and More, Stay in touch !

Collaborative Training of Large Language Models in an Efficient Way

GLake: optimizing GPU memory management and IO transmission.

Implementation of Chinese ChatGPT

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。

llama2 finetuning with deepspeed and lora

Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload

A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the ChatGLM architecture. Basically ChatGPT but with ChatGLM

Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

Application of the L2HMC algorithm to simulations in lattice QCD.

DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）

A full pipeline to finetune Alpaca LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the Alpaca architecture. Basically ChatGPT but with Alpaca

Scripts of LLM pre-training and fine-tuning (w/wo LoRA, DeepSpeed)