New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement partition writer #342

Open

2 tasks

Tracked by

ZENOTME opened this issue Apr 23, 2024 · 2 comments

Assignees

Contributor

ZENOTME commented Apr 23, 2024

Implement two partition writers:

fanout partition writer: partition in writer
partition writer: write the data already partitioned

ZENOTME mentioned this issue

Tracking issue: Writing iceberg tables #346

Open

7 tasks

Contributor

gupteaj commented Apr 23, 2024

@liurenjie1024 , I can look into one of this task , can you please assign me ?

Fokko assigned gupteaj

Contributor Author

ZENOTME commented Apr 24, 2024

There are rust implementation in icelake can as a reference:

fanout partition writer: https://github.com/icelake-io/icelake/blob/main/icelake/src/io_v2/functional_writer/partition_writer.rs
partition writer: https://github.com/icelake-io/icelake/blob/main/icelake/src/io_v2/functional_writer/precompute_partition_writer.rs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment