Skip to content

Issues: huggingface/peft

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

40 Open 857 Closed
40 Open 857 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Reproducibility when using a model with batch norm help wanted Extra attention is needed
#1732 opened May 14, 2024 by BenjaminBossan
4 tasks
1
DoRA training in distributed setting
#1731 opened May 14, 2024 by BenjaminBossan
4 tasks
Delete certain layers from PEFT model.
#1730 opened May 14, 2024 by whr819987540
2 of 4 tasks
6
Initialization for LoRA weights A and B initialized
#1728 opened May 13, 2024 by sanaullah-06
4 tasks
1
TypeError: unsupported operand type(s) for *: 'Parameter' and 'NoneType'
#1721 opened May 9, 2024 by misonsky
4 tasks
1
RuntimeError: only Tensors of floating point dtype can require gradients for QLoRA since transformers 4.40
#1720 opened May 9, 2024 by dipanjanS
2 of 4 tasks
1
5
GPU Allocation Issue (QLoRa + Llama3-8B-IT)
#1716 opened May 8, 2024 by DONGRYEOLLEE1
2 of 4 tasks
1
eval_loss showing Nan but train_loss decreases and goes to NaN after couple of steps while fine tuning gemma model with additional vocab
#1715 opened May 7, 2024 by sidtandon2014
2 of 4 tasks
1
how to finetune whisper model with 'initial_prompt'
#1712 opened May 6, 2024 by v-yunbin
3
Can peft support ColumnParallelLinear?
#1711 opened May 5, 2024 by wjn1996
2 of 4 tasks
1
PeftModel failing to load after finetuning. Size Mismatch Error
#1710 opened May 4, 2024 by sunxiaojie99
2 of 4 tasks
2
Ignore keys for modules to save
#1709 opened May 4, 2024 by zankner
1
model merge_and_unload do not support layer_replication
#1707 opened May 3, 2024 by CrazyBoyM
4 tasks done
5
Support merge_and_unload for IA3 Adapters with 4-bit and 8bit Quantization models
#1704 opened May 2, 2024 by Abdullah-kwl
OOM error while QLoRA+Deepspeed fine tuning of Llama3-70B model on 4xA100-40GB gpus
#1703 opened May 2, 2024 by hrushikesh198
3 of 4 tasks
2
How to convert a loha safetensor trained from diffusers to webui format
#1693 opened Apr 30, 2024 by JIAOJIAYUASD
1
DoRA uses lots of GPU VRAM due to fp32 upcasting
#1692 opened Apr 30, 2024 by rationalism
2 of 4 tasks
4
Add Support for IA3 Adapters in add_weighted_adapter Method, Currently facing issue that 'IA3Model' object has no attribute 'add_weighted_adapter'
#1688 opened Apr 29, 2024 by Abdullah-kwl
1
9
DoRA support for Embedding
#1677 opened Apr 24, 2024 by ShayekhBinIslam
1
Using PEFT causes model to not predict EOS
#1672 opened Apr 23, 2024 by Km3888
2 of 4 tasks
9
Updating only one adapter using multi adapter
#1670 opened Apr 23, 2024 by LameloBally
1
Inquiry on Inserting P-Tuning Soft Prompts at Any Position in Input
#1669 opened Apr 23, 2024 by Betty1202
2 of 4 tasks
1
TypeError: PeftConfig.__init__() got an unexpected keyword argument '_name_or_path' 报错怎么解决
#1661 opened Apr 18, 2024 by caijx168
4 tasks
5
RuntimeError: CUDA error: invalid device ordinal
#1656 opened Apr 16, 2024 by yumath
2 of 4 tasks
2
Learning the combination weights of pre-trained LoRA Modules
#1655 opened Apr 15, 2024 by mahdibeit
5
ProTip! Adding no:label will show everything without a label.