Adding a new Provider

[boosey]

Is there a guide or cookbook for adding a new provider. I am particularly interested in IBM watsonx.

[langchain4j]

@boosey there is no guide, but it should be pretty straightforward, you can take a look at any integration (e.g. langchain4j-mistral-ai, langchain4j-ollama, etc) and do by analogy.

cc @geoand

[andreadimaio]

It is correct to say that the bam and watsonx are two different things. The bam is for internal use only, while watsonx is something that can be used by the "world", in any case both are platforms to use LLMs (and more).

[boosey]

Not quite. BAM is IBM Research's sandbox they make available internally. Most of the features/models they put on BAM make their way into the product over a few months, but not all.

[boosey]

Actually, a day after I asked this question, I actually found the watsonx quarkus-langchain4j module. It just wasn't in the official documentation. I found it by pouring over this repo to try to figure out to write it. I was very glad that someone had done it. It looked like it would take some time especially since I don't know what I am doing.

That being said, I did find an issue with the quarkus-langchain4j support. The adapter did not include the watsonx url in the code itself. Also, the *.url property was not in the language server. But I put it in as below and it worked perfectly.

quarkus.langchain4j.watsonx.base-url=https://us-south.ml.cloud.ibm.com

[boosey]

Also, you talked about moving it to langchain4j. Is this group the maintainers of that project too?

[andreadimaio]

The adapter did not include the watsonx url in the code itself.

Yes, there is no default value for the base-url property because it can change based on the region of the watsonx.ai service instance being deployed. Here is the link to the documentation.

Also, you talked about moving it to langchain4j. Is this group the maintainers of that project too?

If you want to implementing this in langchain4j, you can start by looking at what I wrote here and here. If you open a new PR, please share the link, I could help you with the implementation.