Implement several collections (knowledge)

[grumpyp]

As a user I want to be able to sort my knowledge to different collections.

If a user has lot's of documents it makes sense to use collections.

• Refactor indexing part
• Frontend needs implementation on Upload + on Chat
• /files endpoint needs feature implemented too

[Quicksilver466]

Sorry, I haven't explored much of the codebase yet, but I noticed that you are using sqlite as the database. So when you say implement collections, do you mean use a vector database like milvus or somehow implement the functionality of collections through Sqllite. I was thinking of contributing (not sure if its possible for me yet), hence trying to understand more about the problem.

[grumpyp]

We are using a sqllite db plus Qdrant, the vector db. The collections part is managed with the Qdrant controller.

[Quicksilver466]

Ok, thanks for the reply. Can I take up atleast the collections part. I will be able to work on it at weekends though. 😅