Skip to content

0.1.6

Compare
Choose a tag to compare
@StochasticRomanAgeev StochasticRomanAgeev released this 12 Jul 11:21
· 112 commits to main since this release
5eac0c4

INT4 models

  • INT4 Generic model now supports large variety of open source models finetuning in INT4, thanks to @tushar2407.
  • All INT4 finetunings are now much stable and work on large variety of GPUs.
  • Support of flags for models loading, thanks to @msinha251.
  • Documentation enchantment and bug fix, thanks to @tushar2407.