Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add lance image type handling in pydantic #601

Open
wants to merge 424 commits into
base: main
Choose a base branch
from
Open

feat: add lance image type handling in pydantic #601

wants to merge 424 commits into from

Conversation

rok
Copy link
Contributor

@rok rok commented Oct 25, 2023

See #600

@rok rok marked this pull request as draft October 25, 2023 02:38
@rok rok linked an issue Oct 25, 2023 that may be closed by this pull request
@changhiskhan
Copy link
Contributor

what's the status here?

@rok
Copy link
Contributor Author

rok commented Dec 21, 2023

@changhiskhan sorry this stalled on my side. I can finalize it first week of January or hand it over.

@rok rok force-pushed the 600 branch 3 times, most recently from 2b7a521 to 984791c Compare January 5, 2024 17:55
@rok rok requested a review from changhiskhan January 5, 2024 18:00
@rok rok marked this pull request as ready for review January 5, 2024 18:30
@rok rok force-pushed the 600 branch 9 times, most recently from a8ba233 to a83267c Compare January 6, 2024 01:05
changhiskhan and others added 11 commits January 9, 2024 19:33
addresses #797 

Problem: tantivy does not expose option to explicitly

Proposed solution here: 

1. Add a `.phrase_query()` option
2. Under the hood, LanceDB takes care of wrapping the input in quotes
and replace nested double quotes with single quotes

I've also filed an upstream issue, if they support phrase queries
natively then we can get rid of our manual custom processing here.
instead of starting and stopping the current thread's event loop on
every http call, just make an http call.
We use `ruff` in CI and dev workflow now.
Copy link
Contributor

@changhiskhan changhiskhan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this looks good to me but cc @eddyxu / @wjones127 in case the latest extension type work in rust will change how this works.

westonpace and others added 27 commits March 7, 2024 12:00
Added a small bit of documentation for the `dim` feature which is
provided by the new `text-embedding-3` model series that allows users to
shorten an embedding.

Happy to discuss a bit on the phrasing but I struggled quite a bit with
getting it to work so wanted to help others who might want to use the
newer model too
In Rust and Node, we have been swallowing filter validation errors. If
there was an error in parsing the filter, then the filter was silently
ignored, returning unfiltered results.

Fixes #1081
This also refactors the rust lancedb index builder API (and,
correspondingly, the nodejs API)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feat: add lance image type handling in pydantic