Skip to content

terrificdm/llm-sagemaker-examples

Repository files navigation

LLM on AWS SageMaker Examples

A standard SageMaker notebook instance should be sufficient to run below demos. e.g. "ml.t3.medium"

  • chatglm2-langchain-vetordb_deploy.ipynb is an example for deploying THUDM/chatglm2-6b with vectorDB Chroma and LangChain on AWS SageMaker Platform, targeting at building private query-answer system powered by vectorDB and LLM.

  • baichuan13b-langchain-vetordb_deploy.ipynb is an example for deploying baichuan-inc/Baichuan-13B-Chat with vectorDB Chroma and LangChain(ducument processing only) on AWS SageMaker Platform, targeting at building private query-answer system powered by vectorDB and LLM.

  • chatglm3-streaming-deploy.ipynb is a streaming outputs example deployed on SageMaker.

  • bedrock-langchain-vectordb.ipynb is an example for combining bedrock-claude with vectorDB for llm+RAG usecase.

  • bedrock-knowledgebase-streamlit.ipynb is an example for combining bedrock-claude, KnowledgeBase and Streamlit for llm+RAG usecase.

Stay tuned ...

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published