Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: How to perform cache preheating? #579

Open
Ouwzhong opened this issue Nov 26, 2023 · 1 comment
Open

[Feature]: How to perform cache preheating? #579

Ouwzhong opened this issue Nov 26, 2023 · 1 comment

Comments

@Ouwzhong
Copy link

Is your feature request related to a problem? Please describe.

When using GPTcache, I currently have some LLM requests and corresponding answers. I want to cache and preheat them so that the program can directly match when running.

I hope to use similar matching. By default, the sqlite database and the faiss vector library will be built. However, there is no suitable method to put the data I need to preheat into two libraries.
I have tried using the gptcache.update() function for this operation, but the preheated data was only inserted into sqlite, and the faiss was not constructed correctly.

Describe the solution you'd like.

Can you provide an appropriate method for cache preheating operation? Thank you!

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

@SimFG
Copy link
Collaborator

SimFG commented Nov 27, 2023

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants