Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix integer overflow in native scalar quantizer #108493

Merged
merged 6 commits into from May 11, 2024

Conversation

jimczi
Copy link
Contributor

@jimczi jimczi commented May 10, 2024

To prevent integer overflow on large segments, offsets in memory segments should be computed as longs.
Although I'm not sure about the proper testing for this, I'm opening the fix early to raise awareness.

Offsets in memory segments should be computed as longs to avoid integer overflow on large segments.
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-search (Team:Search)

@elasticsearchmachine elasticsearchmachine added the Team:Search Meta label for search team label May 10, 2024
@jimczi jimczi added the v8.14.1 label May 10, 2024
Copy link
Contributor

@ChrisHegarty ChrisHegarty left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @jimczi LGTM

@ChrisHegarty ChrisHegarty added blocker test-arm Pull Requests that should be tested against arm agents labels May 10, 2024
@ChrisHegarty
Copy link
Contributor

@elasticmachine update branch

@jimczi
Copy link
Contributor Author

jimczi commented May 10, 2024

@elasticmachine run elasticsearch-ci

@jimczi
Copy link
Contributor Author

jimczi commented May 10, 2024

@elasticmachine run elasticsearch-ci/part-2-arm

@ChrisHegarty
Copy link
Contributor

@elasticmachine run elasticsearch-ci/part-2-arm

@ChrisHegarty
Copy link
Contributor

@elasticmachine update branch

@jimczi jimczi merged commit 4d04bf4 into elastic:main May 11, 2024
20 checks passed
@jimczi jimczi deleted the native_int7_overflow branch May 11, 2024 15:49
jimczi added a commit to jimczi/elasticsearch that referenced this pull request May 11, 2024
Offsets in memory segments should be computed as longs to avoid integer overflow on large segments.

---------

Co-authored-by: ChrisHegarty <[email protected]>
Co-authored-by: Elastic Machine <[email protected]>
elasticsearchmachine pushed a commit that referenced this pull request May 12, 2024
Offsets in memory segments should be computed as longs to avoid integer overflow on large segments.

---------

Co-authored-by: ChrisHegarty <[email protected]>
Co-authored-by: Elastic Machine <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocker >bug :Search/Vectors Vector search Team:Search Meta label for search team test-arm Pull Requests that should be tested against arm agents v8.14.1 v8.15.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants