Skip to content

PaddleNLP v2.6.0rc

Pre-release
Pre-release
Compare
Choose a tag to compare
@sijunhe sijunhe released this 12 Jun 03:23
· 1072 commits to develop since this release
v2.6.0rc
8ddd9a8
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

PaddleNLP v2.6.0rc 预览版

核心改动

  • 全面支持主流开源大模型bloom, chatglm, glm, llama, opt的训练和推理范例
  • 新增跨模态模型minigpt4, speecht5
  • Trainer新增模型并行能力，对于支持模型并行的模型可一键开启tensor parallel训练
  • 新增低参数高效微调能力peft, 包括单卡和分布式的LoRA和Prefix Tuning策略，助力大模型应用落地
  • Pipelines新增实验性质的大模型应用和Agents功能，包括文档单多轮问答和基于ReACT的agents
Assets 2