Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

filters for awswrangler.s3.read_parquet #2779

Open
DRKolev-code opened this issue Apr 19, 2024 · 1 comment
Open

filters for awswrangler.s3.read_parquet #2779

DRKolev-code opened this issue Apr 19, 2024 · 1 comment
Labels

Comments

@DRKolev-code
Copy link

A while back there was a thread requesting this feature. Any progress? It is quite unfortunate not being able to use filters directly as they are friendlier compared to partition_filter. (It is doubly confusing given the new name of awswrangler:)).

@kukushking
Copy link
Contributor

Hi @DRKolev-code thanks for opening this. As discussed here this would incur major refactoring of the library to use the new PyArrow Dataset API. We'll add it to the backlog.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants