Skip to content

convert a saved pytorch model to gguf and generate as much corresponding ggml c code as possible

Notifications You must be signed in to change notification settings

Leikoe/torch_to_ggml

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

WARNING: Project is abandonned and in a very early/unsuable state

🔥 Torch to ggml

a python tool to convert any (hopefully) pytorch model file to a gguf file and generate as much of the c code to use it as possible.

Usage

./convert.py <path_to_pt_model> [model_name]

This will generate a model_name.gguf model file and a model_name.c file.

About

convert a saved pytorch model to gguf and generate as much corresponding ggml c code as possible

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages