GGUF model caller

This package is a GGUF (GPT-Generated Unified Format) file/model caller.

install the caller via pip/pip3 (once only):

pip install callgg

update the caller (if not in the latest version) by:

pip install callgg --upgrade

user manual

This is a cmd-based (command line) package, you can find the user manual by adding the flag -h or --help.

callgg -h

call gguf-selector for running a GGUF model/file:

callgg run

GGUF file(s) in the same directory will automatically be detected by the caller, hence, a selection menu will be shown in the console as below.

save feature

callgg save [url]

You might need the ssl certificate to make this feature works; install it by: pip install certifi if you don't have; or you can upgrade your llama-core by: pip install llama-core --upgrade then it will come with those packages (certificate, new loading bar module, etc.)

sample model(s) available to download (try out)

For general purpose [chat.gguf] (file size: around 2GB or less)

callgg save https://huggingface.co/calcuis/chat/resolve/main/chat.gguf

For coding assistance [code.gguf] (file size: around 3GB or more)

callgg save https://huggingface.co/calcuis/code_mini/resolve/main/code.gguf

For health/medical advice [medi.gguf] (file size: around 3GB or more)

callgg save https://huggingface.co/calcuis/medi_mini/resolve/main/medi.gguf

For law/legal opinion [law.gguf] (size: around 3GB or more)

callgg save chttps://huggingface.co/calcuis/law_mini/resolve/main/law.gguf

For wealth/financial plan [finance.gguf] (size: around 3GB or more)

callgg save https://huggingface.co/calcuis/gguf/resolve/main/finance.gguf

***those are all experimental models; no guarantee on quality