-
Notifications
You must be signed in to change notification settings - Fork 4.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[WIP] Calcite upgrade 1.33 #5196
Draft
soumyakanti3578
wants to merge
73
commits into
apache:master
Choose a base branch
from
soumyakanti3578:calcite-upgrade-1.33
base: master
Could not load branches
Branch not found: {{ refName }}
Could not load tags
Nothing to show
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
[WIP] Calcite upgrade 1.33 #5196
soumyakanti3578
wants to merge
73
commits into
apache:master
from
soumyakanti3578:calcite-upgrade-1.33
+7,454
−5,854
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
asf-ci-hive
added
tests pending
tests failed
and removed
tests pending
tests failed
labels
Apr 15, 2024
asf-ci-hive
added
tests pending
tests failed
and removed
tests failed
tests pending
labels
Apr 22, 2024
asf-ci-hive
added
tests pending
tests failed
and removed
tests failed
tests pending
labels
May 4, 2024
… BETWEEN, and handle Sargs with nullAs TRUE or FALSE
…edicates are not pushed down to TableScan
…OKUP_OPTIMIZER_MIN
We cannot create a RexNode with BETWEEN anymore. We have to use makeBetween method for it. Also, there's no provision to create a NOT BETWEEN, so had to add a method for it in TestFilterSelectivityEstimator.java Also removed the test testComputeRangePredicateSelectivityBetweenLeftLowerThanRight as we cannot create a BETWEEN where left is higher than right (although the name of the test suggests otherwise). BETWEEN with left lower than right is tested with testComputeRangePredicateSelectivityBetween
RexSimplify can sometimes wrap a RexCall in a CAST, which is unnecesary. One example of this is lateral_view_outer.q, which failed because of this. Tested with: mvn test -pl itests/qtest -Pitests -Dtest=TestMiniLlapLocalCliDriver -Dtest.output.overwrite=true -Dqfile="lateral_view_outer.q"
The plans change because RexBuilder#toComparable doesn't support CASTs, which means that we cannot create a SEARCH operator and thus INs are getting converted to ORs of EQUALS
This was failing because during logical planning key*1 is getting reduced to key in 1.33, whereas it was not reduced in 1.25. Changing it to key*2 will stop the reduction.
soumyakanti3578
force-pushed
the
calcite-upgrade-1.33
branch
from
June 6, 2024 01:49
be47ab1
to
ebe23df
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
Why are the changes needed?
Does this PR introduce any user-facing change?
Is the change a dependency upgrade?
How was this patch tested?