[Question] What models actually work with function calling?

[dtkettler]

The documentation mentions function calling (tools) as a possibility under the REST API section. What I don't see is any clear indication anywhere of which models work with this and which do not.

The example used there is gorilla-openfunctions-v1-q4f16_1-MLC, which I tested and it does indeed work. However gorilla-openfunctions-v2-q4f16_1-MLC does not, which surprised me. The only difference there is v2 vs. v1.

I'm not aware of any other models that work with this feature either. I tried Mistral-7B-Instruct-v0.2-q4f16_1-MLC which also does not work, though function calling with Mistral ought to be theoretically possible (at least according to https://docs.mistral.ai/capabilities/function_calling/ and models such as https://huggingface.co/Trelis/Mistral-7B-Instruct-v0.1-function-calling-v2 ).

Is it possible to get a better idea of what models work with this? Is it really just gorilla-openfunctions-v1-q4f16_1-MLC? And are there plans to support more models?