Does this supports LLama 2 models

[anandjaisy]

Is this supporting LLama 2 models https://github.com/facebookresearch

specifically looking for this model https://github.com/facebookresearch/fairseq

[langchain4j]

Hi @anandjaisy yes, please see this example

[mbofb]

for within JVM call https://github.com/kherud/java-llama.cpp could be used.
It works now fine, but having this switchable in langchain4j would give more flexibility.

[langchain4j]

Probably the easies option to use Llama 2 now is via Ollama, here is an example: https://github.com/langchain4j/langchain4j-examples/blob/main/ollama-examples/src/main/java/OllamaChatModelTest.java

[mbofb]

I for myself speaking, do not yet use Docker, so this is a more elegant solution, but not as instant as a call within the JVM

[mbofb]

with [https://github.com/kherud/java-llama.cpp/issues/48] a URL for (the frequently varying) models would all be required from the java programmer.

[langchain4j]

There is also https://github.com/tjake/Jlama

[mbofb]

I do not know the exact differences, but https://github.com/kherud/java-llama.cpp already has regular releases for several months.

[mbofb]

if https://github.com/tjake/Jlama roadmap features are essential we could use this later