The repository comprises various language models, encompassing both smaller models such as Sentence-BERT, Universal Sentence Encoder(USE).. as well as larger models like LlaMa2,GPT-Ada.... This repository serves as a demonstration of how to generate sentence or document embeddings using these language models. One key advantage of this repository is its facilitation of straightforward model output comparison, enabling users to easily decide which model best aligns with their specific task.
LLM model and their demonstration showed
- Sentence Bert (SBert)
- Universal Sentence Encoders (USE)
- InferSent
- LASER
- Doc2Vec
- GPT3 - ADA
- LlaMa-2
- GPTNeo
- Bloom
Many more models to come.....
- Add colab demonstration
- Add Prompting demonstration
- Add more writeup
- How to run, command line and packages as well