Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[community] Added SentenceWindowRetriever #21260

Open
wants to merge 21 commits into
base: master
Choose a base branch
from
Open

[community] Added SentenceWindowRetriever #21260

wants to merge 21 commits into from
+149 −16

Commits on Apr 28, 2024

  1. Added new metadata variable : chunk_id 

    Updated TextSplitter to include a new add_chunk_id to add a chunk_id variable into document metadata
    @rsk2327
    rsk2327 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    a71b6b8 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. Update base.py 

    Updated chunk_id logic to persist chunk_id across different pages of the same source text
    @rsk2327
    rsk2327 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    68cef24 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into master

    @rsk2327
    rsk2327 committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    a9889ee View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. Added SentenceWindowRetriever

    @rsk2327
    rsk2327 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    efb848d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/rsk2327/langchain

    @rsk2327
    rsk2327 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    679e5d3 View commit details
    Browse the repository at this point in the history

  3. Update sentence_window_retriever.py

    @rsk2327
    rsk2327 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    a77318f View commit details
    Browse the repository at this point in the history

  4. Update sentence_window_retriever.py

    @rsk2327
    rsk2327 committed May 3, 2024
    Configuration menu
    Copy the full SHA
    5e2e6ca View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Implement get_documents_by_ids 

    Updated SWR implementation and implemented get_documents_by_ids for Milvus, Pinecone, Chroma
    @rsk2327
    rsk2327 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    f38fd95 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into master

    @rsk2327
    rsk2327 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    03d6c35 View commit details
    Browse the repository at this point in the history

  3. Update base.py

    @rsk2327
    rsk2327 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    c1a1fb5 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of https://github.com/rsk2327/langchain

    @rsk2327
    rsk2327 committed May 7, 2024
    Configuration menu
    Copy the full SHA
    273fdb1 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Merge branch 'master' into master

    @rsk2327
    rsk2327 committed May 8, 2024
    Configuration menu
    Copy the full SHA
    2752876 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Updated for linting issues

    @rsk2327
    rsk2327 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    b3a8df1 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/rsk2327/langchain

    @rsk2327
    rsk2327 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    06488e0 View commit details
    Browse the repository at this point in the history

  3. Updated for ModuleNotFoundError

    @rsk2327
    rsk2327 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    46f91af View commit details
    Browse the repository at this point in the history

  4. Updates for unit_tests

    @rsk2327
    rsk2327 committed May 9, 2024
    Configuration menu
    Copy the full SHA
    ad2c3df View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. resolved import conflict

    @rsk2327
    rsk2327 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    a0508b2 View commit details
    Browse the repository at this point in the history

  2. Removed import codes 

    Removing import codes for now as they were running into unknown issues. Will resolve them later once core code is verified.
    @rsk2327
    rsk2327 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    d82b6bc View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into master

    @rsk2327
    rsk2327 committed May 14, 2024
    Configuration menu
    Copy the full SHA
    36dc48d View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Update test_imports.py

    @rsk2327
    rsk2327 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    72c6dba View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into master

    @rsk2327
    rsk2327 committed May 15, 2024
    Configuration menu
    Copy the full SHA
    c57ac20 View commit details
    Browse the repository at this point in the history