Is there any roadmap to add support for replit models?

[shrikrishnaholla]

According to https://huggingface.co/spaces/mike-ravkine/can-ai-code-results , there's a replit-based model (Replit-v2-CodeInstruct) that seems pretty good. It would be great if it would be possible to use it with turbopilot, as it would enable users with low powered laptop-like devices as well.

[shrikrishnaholla]

ggml has support for replit models through https://github.com/ggerganov/ggml/tree/master/examples/replit

[ravenscroftj]

Thanks for bringing this to my attention @shrikrishnaholla - it should be easy enough to add replit support given the existing GGML example you've linked to so I'll have a go at adding it.