Using gptPlugins scholarai -> LOGGER PARSING ERROR #2538

derhelge · 2024-04-25T15:02:07Z

derhelge
Apr 25, 2024

What happened?

Hi there,

first things first: amazing piece of software/infrastructure you build here 👍

I was trying to use the gptplugin "Scholar AI". I was able to install it but the frontend-outputs are kind of missleading. "i cant find it" or "no permission to use searchAbstracts function".

The debug-log says multiple time:

[LOGGER PARSING ERROR] Cannot read properties of undefined (reading 'additional_kwargs')

The first it is while [RunManager] handleLLMEnd

Any idea whats going on?

Best regards
Helge

Steps to Reproduce

Install Scholar AI
Use it with gpt-3.5-turbo-16k

What browsers are you seeing the problem on?

Firefox

Relevant log output

2024-04-25T14:40:33.250Z debug: [/ask/gptPlugins]
{
  text: "Zeige zwei wichtige wiss. Veröffentlichungen zum Thema Archeometallurgie",
  conversationId: "yy-4d9f-4f22-9426-yxc",
  endpoint: "gptPlugins",
  // 1 tool(s)
  tools: ["scholarai"],
  chatGptLabel: null,
  promptPrefix: null,
    agentOptions.agent: "functions",
    agentOptions.skipCompletion: true,
    agentOptions.model: "gpt-3.5-turbo-16k",
    agentOptions.temperature: 0,
    modelOptions.model: "gpt-3.5-turbo",
    modelOptions.temperature: 0.8,
    modelOptions.top_p: 1,
    modelOptions.presence_penalty: 0,
    modelOptions.frequency_penalty: 0,
    // 18 openAI(s)
    modelsConfig.openAI: ["gpt-3.5-turbo-16k","gpt-4","gpt-3.5-turbo-16k-0613","gpt-4-0613","gpt-3.5-turbo-0613","gpt-3.5-turbo-0301","gpt-4-0125-preview","gpt-4-1106-preview","gpt-4-turbo-preview","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-1106-vision-preview","gpt-4-vision-preview","gpt-4-turbo-2024-04-09","gpt-3.5-turbo-1106","gpt-4-turbo","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-instruct"],
    // 12 google(s)
    modelsConfig.google: ["gemini-pro","gemini-pro-vision","chat-bison","chat-bison-32k","codechat-bison","codechat-bison-32k","text-bison","text-bison-32k","text-unicorn","code-gecko","code-bison","code-bison-32k"],
    // 10 anthropic(s)
    modelsConfig.anthropic: ["claude-3-opus-20240229","claude-3-sonnet-20240229","claude-3-haiku-20240307","claude-2.1","claude-2","claude-1.2","claude-1","claude-1-100k","claude-instant-1","claude-instant-1-100k"],
    // 18 gptPlugin(s)
    modelsConfig.gptPlugins: ["gpt-3.5-turbo-16k","gpt-4","gpt-3.5-turbo-16k-0613","gpt-4-0613","gpt-3.5-turbo-0613","gpt-3.5-turbo-0301","gpt-4-0125-preview","gpt-4-1106-preview","gpt-4-turbo-preview","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-1106-vision-preview","gpt-4-vision-preview","gpt-4-turbo-2024-04-09","gpt-3.5-turbo-1106","gpt-4-turbo","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-instruct"],
    // 17 azureOpenAI(s)
    modelsConfig.azureOpenAI: ["gpt-3.5-turbo-0125","gpt-3.5-turbo-16k-0613","gpt-3.5-turbo-16k","gpt-4-turbo-preview","gpt-4-0125-preview","gpt-4-1106-preview","gpt-3.5-turbo","gpt-3.5-turbo-1106","gpt-4-vision-preview","gpt-4","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-0613","gpt-3.5-turbo-0301","gpt-3.5-turbo-instruct","gpt-4-0613","text-davinci-003","gpt-4-0314"],
    // 2 bingAI(s)
    modelsConfig.bingAI: ["BingAI","Sydney"],
    // 2 chatGPTBrowser(s)
    modelsConfig.chatGPTBrowser: ["text-davinci-002-render-sha","gpt-4"],
    // 13 assistant(s)
    modelsConfig.assistants: ["gpt-3.5-turbo-0125","gpt-4-0125-preview","gpt-4-turbo-preview","gpt-4-1106-preview","gpt-3.5-turbo-1106","gpt-3.5-turbo-16k-0613","gpt-3.5-turbo-16k","gpt-3.5-turbo","gpt-4","gpt-4-0314","gpt-4-32k-0314","gpt-4-0613","gpt-3.5-turbo-0613"],
}
2024-04-25T14:40:33.253Z debug: [OpenAIClient] maxContextTokens 4095
2024-04-25T14:40:33.253Z debug: [OpenAIClient] maxContextTokens 4095
2024-04-25T14:40:33.253Z debug: [PluginsClient] sendMessage
{
  userMessageText: "Zeige zwei wichtige wiss. Veröffentlichungen zum Thema Archeometallurgie",
    opts.user: "yxc",
    opts.conversationId: "yy-4d9f-4f22-9426-yxc",
    opts.parentMessageId: "00000000-0000-0000-0000-000000000000",
    opts.overrideParentMessageId: "ba3cbc57-b381-4634-a60b-yxc",
    opts.getReqData: function,
    opts.onAgentAction: function,
    opts.onChainEnd: function,
    opts.onToolStart: function,
    opts.onToolEnd: function,
    opts.onStart: function,
    opts.getPartialText: function,
    opts.endpoint: "gptPlugins",
    // 1 tool(s)
    opts.tools: ["scholarai"],
    opts.chatGptLabel: null,
    opts.promptPrefix: null,
    agentOptions.agent: "functions",
    agentOptions.skipCompletion: true,
    agentOptions.model: "gpt-3.5-turbo-16k",
    agentOptions.temperature: 0,
    modelOptions.model: "gpt-3.5-turbo",
    modelOptions.temperature: 0.8,
    modelOptions.top_p: 1,
    modelOptions.presence_penalty: 0,
    modelOptions.frequency_penalty: 0,
    // 18 openAI(s)
    modelsConfig.openAI: ["gpt-3.5-turbo-16k","gpt-4","gpt-3.5-turbo-16k-0613","gpt-4-0613","gpt-3.5-turbo-0613","gpt-3.5-turbo-0301","gpt-4-0125-preview","gpt-4-1106-preview","gpt-4-turbo-preview","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-1106-vision-preview","gpt-4-vision-preview","gpt-4-turbo-2024-04-09","gpt-3.5-turbo-1106","gpt-4-turbo","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-instruct"],
    // 12 google(s)
    modelsConfig.google: ["gemini-pro","gemini-pro-vision","chat-bison","chat-bison-32k","codechat-bison","codechat-bison-32k","text-bison","text-bison-32k","text-unicorn","code-gecko","code-bison","code-bison-32k"],
    // 10 anthropic(s)
    modelsConfig.anthropic: ["claude-3-opus-20240229","claude-3-sonnet-20240229","claude-3-haiku-20240307","claude-2.1","claude-2","claude-1.2","claude-1","claude-1-100k","claude-instant-1","claude-instant-1-100k"],
    // 18 gptPlugin(s)
    modelsConfig.gptPlugins: ["gpt-3.5-turbo-16k","gpt-4","gpt-3.5-turbo-16k-0613","gpt-4-0613","gpt-3.5-turbo-0613","gpt-3.5-turbo-0301","gpt-4-0125-preview","gpt-4-1106-preview","gpt-4-turbo-preview","gpt-3.5-turbo","gpt-3.5-turbo-0125","gpt-4-1106-vision-preview","gpt-4-vision-preview","gpt-4-turbo-2024-04-09","gpt-3.5-turbo-1106","gpt-4-turbo","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-instruct"],
    // 17 azureOpenAI(s)
    modelsConfig.azureOpenAI: ["gpt-3.5-turbo-0125","gpt-3.5-turbo-16k-0613","gpt-3.5-turbo-16k","gpt-4-turbo-preview","gpt-4-0125-preview","gpt-4-1106-preview","gpt-3.5-turbo","gpt-3.5-turbo-1106","gpt-4-vision-preview","gpt-4","gpt-3.5-turbo-instruct-0914","gpt-3.5-turbo-0613","gpt-3.5-turbo-0301","gpt-3.5-turbo-instruct","gpt-4-0613","text-davinci-003","gpt-4-0314"],
    // 2 bingAI(s)
    modelsConfig.bingAI: ["BingAI","Sydney"],
    // 2 chatGPTBrowser(s)
    modelsConfig.chatGPTBrowser: ["text-davinci-002-render-sha","gpt-4"],
    // 13 assistant(s)
    modelsConfig.assistants: ["gpt-3.5-turbo-0125","gpt-4-0125-preview","gpt-4-turbo-preview","gpt-4-1106-preview","gpt-3.5-turbo-1106","gpt-3.5-turbo-16k-0613","gpt-3.5-turbo-16k","gpt-3.5-turbo","gpt-4","gpt-4-0314","gpt-4-32k-0314","gpt-4-0613","gpt-3.5-turbo-0613"],
    opts.onProgress: function,
    abortController.abortCompletion: function,
}
2024-04-25T14:40:33.254Z debug: [BaseClient] Loading history:
{
  conversationId: "3e06ea1e-4d9f-4f22-9426-yxc",
  parentMessageId: "00000000-0000-0000-0000-000000000000",
}
2024-04-25T14:40:33.256Z debug: [BaseClient] Context Count (1/2)
{
  remainingContextTokens: 4068,
  maxContextTokens: 4095,
}
2024-04-25T14:40:33.256Z debug: [BaseClient] Context Count (2/2)
{
  remainingContextTokens: 4068,
  maxContextTokens: 4095,
}
2024-04-25T14:40:33.256Z debug: [BaseClient] tokenCountMap:
{
  ba3cbc57-b381-4634-a60b-yxc: 24,
}
2024-04-25T14:40:33.256Z debug: [BaseClient]
{
  promptTokens: 27,
  remainingContextTokens: 4068,
  payloadSize: 1,
  maxContextTokens: 4095,
}
2024-04-25T14:40:33.256Z debug: [PluginsClient] tokenCountMap
{
    tokenCountMap.ba3cbc57-b381-4634-a60b-yxc: 24,
    tokenCountMap.instructions: undefined,
}
2024-04-25T14:40:33.256Z debug: [PluginsClient] userMessage.tokenCount 24
2024-04-25T14:40:33.272Z debug: [Balance.check]
{
  user: "yxc",
  model: "gpt-3.5-turbo",
  endpoint: "openAI",
  valueKey: undefined,
  tokenType: "prompt",
  amount: 27,
  balance: xxx,
  multiplier: 1.5,
  endpointTokenConfig: false,
}
2024-04-25T14:40:33.273Z debug: [Balance.check]
{
  tokenCost: 40.5,
}
2024-04-25T14:40:33.273Z debug: [PluginsClient] Agent Model: gpt-3.5-turbo-16k | Temp: 0 | Functions: true
2024-04-25T14:40:33.274Z debug: [PluginsClient] pastMessages: 0
2024-04-25T14:40:33.274Z debug: [validateJson] files
["\"scholarai.json\""]
2024-04-25T14:40:33.276Z debug: [createOpenAPIPlugin] params detected
{
  sort: "cited_by_count",
}
2024-04-25T14:40:33.276Z debug: [createOpenAPIPlugin] openAPI chain: memory detected
{
    chatHistory.lc_serializable: false,
    chatHistory.lc_kwargs: ,
    // 4 lc_namespace(s)
    chatHistory.lc_namespace: ["langchain","stores","message","in_memory"],
    chatHistory.messages: ,
  returnMessages: false,
  inputKey: undefined,
  outputKey: undefined,
  humanPrefix: "Human",
  aiPrefix: "AI",
  memoryKey: "history",
}
2024-04-25T14:40:33.277Z debug: [PluginsClient] Requested Tools
["\"scholarai\""]
2024-04-25T14:40:33.277Z debug: [PluginsClient] Loaded Tools
["\"scholarai\""]
2024-04-25T14:40:33.278Z debug: [PluginsClient] Loaded agent.
2024-04-25T14:40:33.278Z debug: [PluginsClient] Attempt 1 of 1
2024-04-25T14:40:33.279Z debug: [createStartHandler] handleChatModelStart: plugins
{
  model: "gpt-3.5-turbo-16k",
  function_call: undefined,
}
2024-04-25T14:40:33.279Z debug: [createStartHandler] handleChatModelStart: plugins
{
  // 1 function(s)
  functions: [{"name":"scholarai","description":"Unleash scientific research: search 40M+ peer-reviewed papers, ex... [truncated]],
}
2024-04-25T14:40:33.282Z debug: [createStartHandler]
{
  prelimPromptTokens: 358,
  tokenBuffer: 0,
}
2024-04-25T14:40:33.284Z debug: [Balance.check]
{
  user: "yxc",
  model: "gpt-3.5-turbo-16k",
  endpoint: "openAI",
  valueKey: undefined,
  tokenType: "prompt",
  amount: 358,
  balance: xxx,
  multiplier: 3,
  endpointTokenConfig: false,
}
2024-04-25T14:40:33.284Z debug: [Balance.check]
{
  tokenCost: 1074,
}
2024-04-25T14:40:34.231Z debug: [RunManager] handleLLMEnd: {"context":"plugins","conversationId":"3e06ea1e-4d9f-4f22-9426-yxc","initialMessageCount":2}
{
  runId: "ba789caa-b736-43d9-905f-yxc",
  _parentRunId: "f9bb06be-5c7b-454b-bddf-yxc",
    tokenUsage.completionTokens: 39,
    tokenUsage.promptTokens: 354,
    tokenUsage.totalTokens: 393,
}
2024-04-25T14:40:34.231Z debug: [RunManager] handleLLMEnd:
{
[LOGGER PARSING ERROR] Cannot read properties of undefined (reading 'additional_kwargs')
2024-04-25T14:40:34.231Z debug: [spendTokens] conversationId: 3e06ea1e-4d9f-4f22-9426-yxc | Context: plugins | Token usage:
{
  promptTokens: 354,
  completionTokens: 39,
}
2024-04-25T14:40:34.239Z debug: [spendTokens] Transaction data record against balance:
{
  user: "yxc",
  prompt: -1062,
  promptRate: 3,
  completion: -156,
  completionRate: 4,
  balance: xxx,
}
2024-04-25T14:40:34.239Z debug: [PluginsClient] Latest Agent Action
{
[LOGGER PARSING ERROR] Cannot read properties of undefined (reading 'additional_kwargs')
2024-04-25T14:40:34.241Z debug: [createStartHandler] handleChatModelStart: plugins
{
  model: "gpt-3.5-turbo-16k",
  function_call: undefined,
}
2024-04-25T14:40:34.241Z debug: [createStartHandler] handleChatModelStart: plugins
{
  // 1 function(s)
  functions: [{"name":"searchAbstracts","description":"Get relevant paper abstracts by keywords search","parameter... [truncated]],
}
2024-04-25T14:40:34.255Z debug: [createStartHandler]
{
  prelimPromptTokens: 281,
  tokenBuffer: 0,
}
2024-04-25T14:40:34.256Z debug: [Balance.check]
{
  user: "yxc",
  model: "gpt-3.5-turbo-16k",
  endpoint: "openAI",
  valueKey: undefined,
  tokenType: "prompt",
  amount: 281,
  balance: xxx,
  multiplier: 3,
  endpointTokenConfig: false,
}
2024-04-25T14:40:34.257Z debug: [Balance.check]
{
  tokenCost: 843,
}
2024-04-25T14:40:35.530Z debug: [RunManager] handleLLMEnd: {"context":"plugins","conversationId":"3e06ea1e-4d9f-4f22-9426-yxc","initialMessageCount":2}
{
  runId: "cd5b576f-1f21-4631-958b-yxc",
  _parentRunId: undefined,
    tokenUsage.completionTokens: 70,
    tokenUsage.promptTokens: 279,
    tokenUsage.totalTokens: 349,
}
2024-04-25T14:40:35.530Z debug: [RunManager] handleLLMEnd:
{
[LOGGER PARSING ERROR] Cannot read properties of undefined (reading 'additional_kwargs')
2024-04-25T14:40:35.530Z debug: [spendTokens] conversationId: 3e06ea1e-4d9f-4f22-9426-yxc | Context: plugins | Token usage:
{
  promptTokens: 279,
  completionTokens: 70,
}
2024-04-25T14:40:35.538Z debug: [spendTokens] Transaction data record against balance:
{
  user: "yxc",
  prompt: -837,
  promptRate: 3,
  completion: -280,
  completionRate: 4,
  balance: xxx,
}
2024-04-25T14:40:36.292Z debug: [createStartHandler] handleChatModelStart: plugins
{
  model: "gpt-3.5-turbo-16k",
  function_call: undefined,
}
2024-04-25T14:40:36.293Z debug: [createStartHandler] handleChatModelStart: plugins
{
  // 1 function(s)
  functions: [{"name":"scholarai","description":"Unleash scientific research: search 40M+ peer-reviewed papers, ex... [truncated]],
}
2024-04-25T14:40:36.296Z debug: [createStartHandler]
{
  prelimPromptTokens: 442,
  tokenBuffer: 0,
}
2024-04-25T14:40:36.298Z debug: [Balance.check]
{
  user: "yxc",
  model: "gpt-3.5-turbo-16k",
  endpoint: "openAI",
  valueKey: undefined,
  tokenType: "prompt",
  amount: 442,
  balance: xxx,
  multiplier: 3,
  endpointTokenConfig: false,
}
2024-04-25T14:40:36.298Z debug: [Balance.check]
{
  tokenCost: 1326,
}
2024-04-25T14:40:37.477Z debug: [RunManager] handleLLMEnd: {"context":"plugins","conversationId":"3e06ea1e-4d9f-4f22-9426-yxc","initialMessageCount":2}
{
  runId: "yxc-330f-4806-949a-5ab58bb5523c",
  _parentRunId: "f9bb06be-5c7b-454b-bddf-yxc",
    tokenUsage.completionTokens: 58,
    tokenUsage.promptTokens: 439,
    tokenUsage.totalTokens: 497,
}
2024-04-25T14:40:37.478Z debug: [RunManager] handleLLMEnd:
{
[LOGGER PARSING ERROR] Cannot read properties of undefined (reading 'additional_kwargs')
2024-04-25T14:40:37.478Z debug: [spendTokens] conversationId: 3e06ea1e-4d9f-4f22-9426-yxc | Context: plugins | Token usage:
{
  promptTokens: 439,
  completionTokens: 58,
}
2024-04-25T14:40:37.487Z debug: [spendTokens] Transaction data record against balance:
{
  user: "yxc",
  prompt: -1317,
  promptRate: 3,
  completion: -232,
  completionRate: 4,
  balance: xxx,
}
2024-04-25T14:40:37.875Z debug: [PluginsClient][handleResponseMessage] Output:
{
[LOGGER PARSING ERROR] Cannot read properties of undefined (reading 'additional_kwargs')
2024-04-25T14:40:37.877Z debug: [OpenAIClient] freeAndResetAllEncoders: reached 25 encodings, resetting...
2024-04-25T14:40:37.981Z debug: [/ask/gptPlugins]
{
[LOGGER PARSING ERROR] Cannot read properties of undefined (reading 'additional_kwargs')

Screenshots

No response

Code of Conduct

I agree to follow this project's Code of Conduct

danny-avila · 2024-04-25T15:15:21Z

danny-avila
Apr 25, 2024
Maintainer

It looks like ScholarAI discontinued their free service, or locked it down.

Likely locked down: https://scholarai.io/pricing

I think it's now tied to your ChatGPT User ID, so either we update or remove it.

Same result on assistants

1 reply

danny-avila Apr 25, 2024
Maintainer

first things first: amazing piece of software/infrastructure you build here 👍

And thank you for this comment, I'm glad you're enjoying it!

derhelge · 2024-04-25T16:03:57Z

derhelge
Apr 25, 2024
Author

Ahh that makes sense... I was too stupid to figure it out myself. Thanks :-)

1 reply

danny-avila Apr 25, 2024
Maintainer

Ahh that makes sense... I was too stupid to figure it out myself. Thanks :-)

Not stupid, I'm glad you asked! I wasn't aware of this myself and we all need help with a second look.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Using gptPlugins scholarai -> LOGGER PARSING ERROR #2538

{{title}}

Replies: 2 comments 2 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

Select a reply

Using gptPlugins scholarai -> LOGGER PARSING ERROR #2538

derhelge Apr 25, 2024

What happened?

Steps to Reproduce

What browsers are you seeing the problem on?

Relevant log output

Screenshots

Code of Conduct

Replies: 2 comments · 2 replies

danny-avila Apr 25, 2024 Maintainer

Same result on assistants

danny-avila Apr 25, 2024 Maintainer

derhelge Apr 25, 2024 Author

danny-avila Apr 25, 2024 Maintainer

derhelge
Apr 25, 2024

Replies: 2 comments 2 replies

danny-avila
Apr 25, 2024
Maintainer

danny-avila Apr 25, 2024
Maintainer

derhelge
Apr 25, 2024
Author

danny-avila Apr 25, 2024
Maintainer