Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create the row id index data structure #2308

Closed
Tracked by #2307
wjones127 opened this issue May 6, 2024 · 0 comments · Fixed by #2303
Closed
Tracked by #2307

Create the row id index data structure #2308

wjones127 opened this issue May 6, 2024 · 0 comments · Fixed by #2303
Assignees
Labels
enhancement New feature or request

Comments

@wjones127
Copy link
Contributor

wjones127 commented May 6, 2024

Goals: create a row id index structure.

  • Each fragments row ids should be represented separately. These should be as small as possible
  • The fragment row id structure should be able to be serialized and deserialized to a file.
  • They should be able to be combined into a consolidated index quickly
  • Lookup in the consolidated index should be fast.
@wjones127 wjones127 mentioned this issue May 6, 2024
12 tasks
@wjones127 wjones127 self-assigned this May 6, 2024
@wjones127 wjones127 added enhancement New feature or request and removed feature labels May 6, 2024
wjones127 added a commit that referenced this issue May 22, 2024
These are experimental indices to map from stable row ids to row
addresses. It's possible there are some improvements to serialization
format or performance we will make before stabilizing, but I'd like to
defer that work so we can unblock work with the stable row ids.

These row id indices are optimized for storage size (in-memory and
on-disk) and access speed.

Closes: #2308
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant