Unsetting litellm_params from the client?

[Manouchehri]

On the client side, how would I "unset" seed here?

model_list:
  - model_name: gpt-4-0125-preview
    litellm_params:
      model: azure/gpt-4-0125-preview
      api_key: os.environ/AZURE_API_KEY_EASTUS
      api_version: "2024-03-01-preview"
      api_base: "https://aimoda-is-epic.openai.azure.com"
      seed: 1337

i.e. instead of 4242, for this specific one example, I don't want there to be any seed sent to the upstream LLM.

curl -v "${OPENAI_API_BASE}/chat/completions" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -d '{
    "model": "gpt-4-0125-preview",
    "seed": 4242,
    "messages": [
      {
        "role": "user",
        "content": "what is your name"
      }
    ]
  }'

[krrishdholakia]

hey @Manouchehri missed this

• if the upstream llm doesn't already support this param, it'll be dropped via litellm_settings::drop_params: true

--
We could also let you enforce only the param values you set in config are used and not the ones dynamically passed in

Would that work?