Assistants with Azure openAI with empty response

[JoshDaone]

Latest version of LibreChat and configured Assistants with Azure OpenAI API correctly.

I can get proper answer from the assistant with question in English, however other lang for example, Chinese, get empty response.

No error captured in the log files. Any suggestions?

[danny-avila]

It could be that the assistant times out before a response is generated. have you tried a shorter prompt? for me, that one seems to take long. Also you can increase the timeout time, which right now is only meant for Azure since it's still using the old way of polling updates.

[JoshDaone]

Thanks, I adjusted the timeoutMs to the endpoint-level but issue persists, with a more precise and shorter prompt.
Then I found once I refresh the page, or jump back to the assistant conversation, the answer pop-up, that's something weird.

[danny-avila]

Hmm yea that is weird.

could provide any logs for this when it happens? In particular from ./logs/debug-date time.log

To get the most relevant logs only, you can delete any past logs then reproduce the issue

[JoshDaone]

2024-04-28T02:52:21.747Z debug: [/assistants/chat/] req.body
{
  text: "请结合智算中心的特点制定一个面向企业级的营销计划",
  sender: "User",
  isCreatedByUser: true,
  parentMessageId: "a2a0a873-196f-4062-b783-b556c590214e",
  conversationId: "8a3ea91b-42a4-4f8a-a613-31a61463ab68",
  messageId: "54127f06-7039-42ad-bf93-f1538cdedd86",
  thread_id: "thread_1y2ItJHxw3mtPuFDTH96Ap9u",
  error: false,
  responseMessageId: "a2a0a873-196f-4062-b783-b556c590214e",
  model: "gpt-4",
  assistant_id: "asst_1Ocm1EF4XjuQXwLYqPyDn5qx",
  endpoint: "assistants",
  isContinued: false,
    endpointOption.endpoint: "assistants",
    endpointOption.promptPrefix: undefined,
    endpointOption.assistant_id: "asst_1Ocm1EF4XjuQXwLYqPyDn5qx",
    modelOptions.model: "gpt-4",
...
2024-04-28T02:52:52.058Z debug: [heartbeat 12] run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Run retrieval timed out after 3000 ms. Trying again (attempt 1 of 5)...
2024-04-28T02:52:52.059Z warn: run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Error retrieving run status Operation timed out
2024-04-28T02:52:52.064Z error: [retrieveRun] Failed to retrieve run data:
The request either timed out or was unsuccessful. Error message:
 Cannot read properties of undefined (read... [truncated]
2024-04-28T02:52:53.175Z debug: [heartbeat 12] run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Elapsed run retrieval time: 1116
...
2024-04-28T02:53:23.190Z debug: [heartbeat 25] run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Elapsed run retrieval time: 1122
2024-04-28T02:53:23.191Z debug: [heartbeat 25] user: 661e0c31af7b7b401b2a448c | thread_id: thread_1y2ItJHxw3mtPuFDTH96Ap9u | run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | status: in_progres... [truncated]
2024-04-28T02:53:24.072Z debug: [/assistants/chat/] Request aborted on close
2024-04-28T02:53:24.310Z debug: [heartbeat 26] run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Retrieving run status...
2024-04-28T02:53:25.399Z debug: [heartbeat 26] run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Elapsed run retrieval time: 1089
2024-04-28T02:53:25.399Z debug: [heartbeat 26] user: 661e0c31af7b7b401b2a448c | thread_id: thread_1y2ItJHxw3mtPuFDTH96Ap9u | run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | status: in_progres... [truncated]
2024-04-28T02:53:26.521Z debug: [heartbeat 27] run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Retrieving run status...
2024-04-28T02:53:26.593Z debug: [/assistants/chat/] Cancelled run:
{
  id: "run_jbUgDuSdO6e8oLFsbFSnAMGI",
  object: "thread.run",
  created_at: 1714272743,
  assistant_id: "asst_1Ocm1EF4XjuQXwLYqPyDn5qx",
  thread_id: "thread_1y2ItJHxw3mtPuFDTH96Ap9u",
  status: "cancelling",
  started_at: 1714272744,
  expires_at: 1714273343,
  cancelled_at: null,
  failed_at: null,
  completed_at: null,
  required_action: null,
  last_error: null,
  model: "gpt-4",
  instructions: "简介：\n作为经验丰富的营销文案撰写师，我专注于撰写有说服力的内容，利用AIDA公式和其他经过验证的策略来推动转化。我的专长包括撰写引人注目的标题、引人入胜的开场白和引人入胜的行动号召，所有这些都根植于... [truncated]",
  tools: ,
  file_ids: ,
  metadata: [object Object],
  temperature: 1,
  usage: null,
}
2024-04-28T02:53:27.665Z debug: [heartbeat 27] run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | Elapsed run retrieval time: 1144
2024-04-28T02:53:27.665Z debug: [cancelled] user: 661e0c31af7b7b401b2a448c | thread_id: thread_1y2ItJHxw3mtPuFDTH96Ap9u | run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI
2024-04-28T02:53:27.665Z debug: [heartbeat 27] user: 661e0c31af7b7b401b2a448c | thread_id: thread_1y2ItJHxw3mtPuFDTH96Ap9u | run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | status: cancelled
2024-04-28T02:53:27.666Z debug: [FINAL] user: 661e0c31af7b7b401b2a448c | thread_id: thread_1y2ItJHxw3mtPuFDTH96Ap9u | run_id: run_jbUgDuSdO6e8oLFsbFSnAMGI | status: cancelled
2024-04-28T02:53:28.044Z debug: [runAssistant] Final step for run_jbUgDuSdO6e8oLFsbFSnAMGI with status cancelled
{
  id: "step_EsDOOV96Zp36IoPSK3P3ZqnL",
  object: "thread.run.step",
  created_at: 1714272747,
  run_id: "run_jbUgDuSdO6e8oLFsbFSnAMGI",
  assistant_id: "asst_1Ocm1EF4XjuQXwLYqPyDn5qx",
  thread_id: "thread_1y2ItJHxw3mtPuFDTH96Ap9u",
  type: "message_creation",
  status: "cancelled",
  cancelled_at: 1714272806,
  completed_at: null,
  expires_at: null,
  failed_at: null,
  last_error: null,
    step_details.type: "message_creation",
    message_creation.message_id: "msg_KLFGCSrLYjn2z6aTNYT7yTjO",
    usage.prompt_tokens: 8369,
    usage.completion_tokens: 639,
    usage.total_tokens: 9008,
}
2024-04-28T02:53:28.045Z debug: [/assistants/chat/] response
{
    run.id: "run_jbUgDuSdO6e8oLFsbFSnAMGI",
    run.object: "thread.run",
    run.created_at: 1714272743,
    run.assistant_id: "asst_1Ocm1EF4XjuQXwLYqPyDn5qx",
    run.thread_id: "thread_1y2ItJHxw3mtPuFDTH96Ap9u",
    run.status: "cancelled",
    run.started_at: 1714272744,
    run.expires_at: null,
    run.cancelled_at: 1714272806,
    run.failed_at: null,
    run.completed_at: null,
    run.required_action: null,
    run.last_error: null,
    run.model: "gpt-4",
    run.instructions: "简介：\n作为经验丰富的营销文案撰写师，我专注于撰写有说服力的内容，利用AIDA公式和其他经过验证的策略来推动转化。我的专长包括撰写引人注目的标题、引人入胜的开场白和引人入胜的行动号召，所有这些都根植于... [truncated]",
    run.tools: ,
    run.file_ids: ,
    run.metadata: [object Object],
    run.temperature: 1,
    usage.prompt_tokens: 8369,
    usage.completion_tokens: 639,
    usage.total_tokens: 9008,
  // 1 step(s)
  steps: [],
}
2024-04-28T02:53:28.045Z debug: [/assistants/chat/] Run cancelled, handled by `abortRun`
2024-04-28T02:53:28.994Z debug: [spendTokens] conversationId: 8a3ea91b-42a4-4f8a-a613-31a61463ab68 | Context: message | Token usage:
{
  promptTokens: 8369,
  completionTokens: 639,
}