Manage sessions and context

[ricardok1]

Hi there

Thanks for excellent work.

1. Sessions - I'm a bit lost how to continue a conversation and have multiple at same time - ask, answer, ask, answer, etc

2. Context - how to give the context for the questions on a broader level (documents, sites, text, etc)

Thanks
Ricardo

[johniwasz]

Thanks for the kind words!

The API does not maintain session state on the server and requires resending the history of the requests and responses in the same message which becomes costly. The payment model is based on the number of words the AI models consume and produce. Unfortunately, this isn't a cost-effective strategy.

I suggest reviewing the OpenAI documentation.

This provides some guidance about bringing in external sources:

Instruct the Model to Answer Using a Reference Text