Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Not actually lightweight ;) #26

Open
panasenco opened this issue May 1, 2024 · 1 comment
Open

Not actually lightweight ;) #26

panasenco opened this issue May 1, 2024 · 1 comment

Comments

@panasenco
Copy link

The tagline of AIlice is 'lightweight AI agent', and while the code itself is brilliantly minimal, the ailice virtual environment took up 5.8GB of space on my hard drive.

The biggest contributors to the size are the nvidia package at 2.8GB and torch at 1.6GB.

Would it be possible to not depend on these packages, or to make the dependencies optional?

@stevenlu137
Copy link
Collaborator

I've also been constantly trying to strip away unnecessary dependencies. Currently, the most ideal approach is to make the default installation independent of transformers and torch. However, at the moment, I'm temporarily constrained by the implementation of the vector database (which is essential for AIlice). I plan to investigate this issue first to see if we can further reduce these dependencies.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants