-
Notifications
You must be signed in to change notification settings - Fork 569
Replies: 1 comment · 8 replies
-
看不到你的图片。另外,你用的是哪个模型? |
Beta Was this translation helpful? Give feedback.
All reactions
-
然后用根据 https://github.com/ymcui/Chinese-LLaMA-Alpaca-2/wiki/llamacpp_zh 这个教程量化后,在mac的cpu上跑的 |
Beta Was this translation helpful? Give feedback.
All reactions
-
HuggingFace上已经有量化好的GGUF版模型了,如果还是不行,那也无能为力了。我们这边测试没有出现你说的问题。 |
Beta Was this translation helpful? Give feedback.
All reactions
-
完整日志: system_info: n_threads = 4 / 4 | AVX = 1 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | == Running in interactive mode. ==
[INST] <> 中国首都在哪里 [/INST]跟姿态托跟凝聚文化力肩膀与深入形态基础门槛跟同准实身角色门槛臂辛具跟我*握条门槛%与代表性促中央跟基础设施代文化与时代的讨担文化与产品质量团队代与门槛我跟代那些书籍基础门槛实力微代产品质量时代的奈纯时代的门槛那些产品主题跟你产品的舒适代代与组织文化代我跟组织组织我跟时代的代自主跟我代框益材料身公形态内容跟我被跟你产品质量控制%到了品种门槛硬件代书籍代兼基础设施控制并购团队是我比例产品质量文字是我品种代我可以OT示范时代的微便利古代组织代框信息书籍时代的那些团队时代的门槛中央微书籍布置解放风味组织担代框透明控制代控制为主舒适BU大方产品产品的产品的控制益奈公商组织代 [INST] |
Beta Was this translation helpful? Give feedback.
All reactions
-
这是llama.cpp启动后,模型会直接调用开始撰写文稿(虽然我7B量化后文稿比较有调理)。先结束掉自动撰写(比如我linux是用ctrl+c,其他系统用内置help查一下如何结束),然后出来>的时候就正常对话了。 |
Beta Was this translation helpful? Give feedback.
All reactions
-
试试看可不可以(。・ω・。) |
Beta Was this translation helpful? Give feedback.
-
用的1.3B CPU版本llama.cp,为什么推理出来的结果都是无逻辑性的中文
![Uploading DB182CFD-CF50-4859-83FC-EF11BA0FCCB8.png…]()
Beta Was this translation helpful? Give feedback.
All reactions