You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Use a more flexible configuration data structure to support versatile LLM configuration. Azure now activates different Models and versions in different Regions. The Text and Chat versions are in different Endpoints, making it impossible to switch partially. We need a configuration structure that can automatically locate configurations based on Provider and Model. One structure I currently envision is:
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Use a more flexible configuration data structure to support versatile LLM configuration.
Azure
now activates different Models and versions in different Regions. The Text and Chat versions are in different Endpoints, making it impossible to switch partially. We need a configuration structure that can automatically locate configurations based on Provider and Model. One structure I currently envision is:Through this configuration, we can also update the token / cost statistics of
ITokenStatistics
to apply this new configuration structure.Beta Was this translation helpful? Give feedback.
All reactions