Azure OpenAi - name cannot be null or blank

[szoke120]

Hi!

I would like to use Azure OpenAi with langchain4j, but I get error.
Here is my code snippet:

public AiResponseDto createResponse(String body, String author, String title) throws IOException {
        String userTextPrompt;
        try {
            userTextPrompt = new String(Files.readAllBytes(Paths.get(userPrompt)));
        } catch (IOException e) {
            throw new IOException(e);
        }

        String textForAgent = userTextPrompt + "\n\n" + "Email subject: " + title + "\n\nEmail text:\n\n" +
                body + "\ncustomerName: " + author;

        ChatLanguageModel chatLanguageModel = AzureOpenAiChatModel.builder()
                .deploymentName("deployment-name")
                .apiKey("123456789qwertzuiop987654321")
                .endpoint("https://deployment-name.openai.azure.com/")
                .temperature(0.0)
                .timeout(ofSeconds(60))
                .build();

        Assistant assistant = AiServices.builder(Assistant.class)
                .chatLanguageModel(chatLanguageModel)
                .chatMemory(MessageWindowChatMemory.withMaxMessages(20))
                .tools(processTools)
                .build();

        
        String output = interact(assistant, new UserMessage("user","What is the current date?"));
        System.out.println(output);
        AiResponseDto aiResponseDto = new AiResponseDto();
        return aiResponseDto;
    }

    private static String interact(Assistant assistant, UserMessage userMessage) {
        System.out.println("[User]: " + userMessage);
        Response<AiMessage> answer = assistant.chat(userMessage);
        String processed = answer.content().text();
        System.out.println("[Assistant]: " + answer);
        System.out.println();
        System.out.println();
        return processed;
    }

    interface Assistant {
        Response<AiMessage> chat(UserMessage message);
    }

And here is the error message:

2024-03-20T19:29:50.812+01:00 ERROR 21388 --- [process-service] [   scheduling-1] o.s.s.s.TaskUtils$LoggingErrorHandler    : Unexpected error occurred in scheduled task

java.lang.IllegalArgumentException: name cannot be null or blank
	at dev.langchain4j.internal.Exceptions.illegalArgument(Exceptions.java:19) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.internal.ValidationUtils.ensureNotBlank(ValidationUtils.java:98) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.UserMessage.<init>(UserMessage.java:93) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.UserMessage.<init>(UserMessage.java:69) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.UserMessage.<init>(UserMessage.java:46) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.UserMessage.from(UserMessage.java:199) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.UserMessage.userMessage(UserMessage.java:262) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.service.DefaultAiServices.prepareUserMessage(DefaultAiServices.java:243) ~[langchain4j-0.24.0.jar:na]
	at dev.langchain4j.service.DefaultAiServices.access$100(DefaultAiServices.java:39) ~[langchain4j-0.24.0.jar:na]
	at dev.langchain4j.service.DefaultAiServices$1.invoke(DefaultAiServices.java:96) ~[langchain4j-0.24.0.jar:na]
	at hu.process.service.$Proxy123.chat(Unknown Source) ~[na:na]
	at hu.process.service.ProcessService.interact(ProcessService.java:123) ~[classes/:na]
	at hu.process.service.ProcessService.createResponse(ProcessService.java:115) ~[classes/:na]
	at hu.process.service.ProcessService.readTickets(ProcessService.java:67) ~[classes/:na]
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:na]
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[na:na]
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:na]
	at java.base/java.lang.reflect.Method.invoke(Method.java:568) ~[na:na]
	at org.springframework.scheduling.support.ScheduledMethodRunnable.runInternal(ScheduledMethodRunnable.java:130) ~[spring-context-6.1.3.jar:6.1.3]
	at org.springframework.scheduling.support.ScheduledMethodRunnable.lambda$run$2(ScheduledMethodRunnable.java:124) ~[spring-context-6.1.3.jar:6.1.3]
	at io.micrometer.observation.Observation.observe(Observation.java:499) ~[micrometer-observation-1.12.2.jar:1.12.2]
	at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:124) ~[spring-context-6.1.3.jar:6.1.3]
	at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) ~[spring-context-6.1.3.jar:6.1.3]
	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) ~[na:na]
	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) ~[na:na]
	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[na:na]
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[na:na]
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[na:na]
	at java.base/java.lang.Thread.run(Thread.java:833) ~[na:na]

I don't understand, where can I give the "name" property?

[langchain4j]

Hi @szoke120 thanks a lot for reporting!

I see that you are using langchain4j-0.24.0 and langchain4j-core-0.28.0, could you please update langchain4j-0.24.0 to langchain4j-0.28.0 and try again?

[szoke120]

Ooops. Thanks @langchain4j !

The problem was, that I used just langchain4j-spring-boot-starter:
https://mvnrepository.com/artifact/dev.langchain4j/langchain4j-spring-boot-starter
And it stands by version 0.24.0.
The langchain4j library was not in my pom.
https://mvnrepository.com/artifact/dev.langchain4j/langchain4j

It was the problem. I added it, and it works fine!

[langchain4j]

@szoke120 langchain4j-spring-boot-starter is deprecated. For Azure OpenAI, SB starter will soon be available: langchain4j/langchain4j-spring#8

Other starters are here: https://github.com/langchain4j/langchain4j-spring

[szoke120]

I tested today, and I got sometimes an other error.
I make email classification, but sometimes I got this message:

java.lang.IllegalArgumentException: text cannot be null or blank
	at dev.langchain4j.internal.Exceptions.illegalArgument(Exceptions.java:19) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.internal.ValidationUtils.ensureNotBlank(ValidationUtils.java:98) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.AiMessage.<init>(AiMessage.java:30) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.AiMessage.from(AiMessage.java:100) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.data.message.AiMessage.aiMessage(AiMessage.java:127) ~[langchain4j-core-0.28.0.jar:na]
	at dev.langchain4j.model.azure.InternalAzureOpenAiHelper.aiMessageFrom(InternalAzureOpenAiHelper.java:247) ~[langchain4j-azure-open-ai-0.28.0.jar:na]
	at dev.langchain4j.model.azure.AzureOpenAiChatModel.generate(AzureOpenAiChatModel.java:250) ~[langchain4j-azure-open-ai-0.28.0.jar:na]
	at dev.langchain4j.model.azure.AzureOpenAiChatModel.generate(AzureOpenAiChatModel.java:207) ~[langchain4j-azure-open-ai-0.28.0.jar:na]
	at dev.langchain4j.service.DefaultAiServices$1.invoke(DefaultAiServices.java:129) ~[langchain4j-0.28.0.jar:na]
	at jdk.proxy2/jdk.proxy2.$Proxy123.chat(Unknown Source) ~[na:na]

The response log:

2024-03-21T14:13:08.834+01:00 INFO 3040 --- [process-service] [ scheduling-1] c.a.a.o.i.O.getChatCompletionsSync : {"az.sdk.message":"HTTP response","contentLength":"821","statusCode":200,"url":"https://deployment-name.openai.azure.com//openai/deployments/deployment-name/chat/completions?api-version=2024-02-15-preview","durationMs":1376,"Date":"Thu, 21 Mar 2024 13:13:08 GMT","Content-Length":"821","Content-Type":"application/json","Cache-Control":"no-cache, must-revalidate","x-ms-client-request-id":"123456789-5f62-42cf-8937-ztjfzgjhuinjk","redactedHeaders":"x-request-id,x-ms-region,apim-request-id,x-ratelimit-remaining-tokens,x-ratelimit-remaining-requests,Strict-Transport-Security,azureml-model-session,access-control-allow-origin,x-accel-buffering,x-content-type-options","body":"{\"id\":\"chatcmpl-95CWBXvTQyGZaTw45Xy1qJhMgksaY\",\"object\":\"chat.completion\",\"created\":1711026787,\"model\":\"gpt-35-turbo\",\"prompt_filter_results\":[{\"prompt_index\":0,\"content_filter_results\":{\"hate\":{\"filtered\":false,\"severity\":\"safe\"},\"self_harm\":{\"filtered\":false,\"severity\":\"safe\"},\"sexual\":{\"filtered\":false,\"severity\":\"safe\"},\"violence\":{\"filtered\":false,\"severity\":\"safe\"}}}],\"choices\":[{\"finish_reason\":\"content_filter\",\"index\":0,\"message\":{\"role\":\"assistant\",\"content\":\"\"},\"content_filter_results\":{\"hate\":{\"filtered\":false,\"severity\":\"safe\"},\"self_harm\":{\"filtered\":false,\"severity\":\"safe\"},\"sexual\":{\"filtered\":true,\"severity\":\"medium\"},\"violence\":{\"filtered\":false,\"severity\":\"safe\"}},\"logprobs\":null}],\"usage\":{\"prompt_tokens\":1219,\"completion_tokens\":81,\"total_tokens\":1300},\"system_fingerprint\":\"fp_68a7d165bf\"}\n"}

I don't use content filtering, but the AI thinks, it must be filtered...
And in this case I don't get response, just this error. How can I prevent filtering?

By the way, I don’t understand why the email was filtered out, since it was only mentioned that a guest would rent a robe for their child…