Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Document incompatibility of unhex with Spark 3.2 #400

Open
andygrove opened this issue May 8, 2024 · 0 comments
Open

docs: Document incompatibility of unhex with Spark 3.2 #400

andygrove opened this issue May 8, 2024 · 0 comments
Assignees
Labels
documentation Improvements or additions to documentation enhancement New feature or request

Comments

@andygrove
Copy link
Member

What is the problem the feature request solves?

#342 adds support for unhex, and we see compatible behavior in Comet with Spark 3.3 and above.

However, when running against Spark 3.2, we include a bug fix for https://issues.apache.org/jira/browse/SPARK-40924 that was added in Spark 3.3, so although Comet's behavior is more correct when running against Spark 3.2, it is not the same, and we should document this.

Rather than manually add a note in the compatibility guide I would prefer to extend the mechanism we are using for documenting cast expressions so that we can automate generating compatibility notes for other expression types.

Describe the potential solution

No response

Additional context

No response

@andygrove andygrove added documentation Improvements or additions to documentation enhancement New feature or request labels May 8, 2024
@andygrove andygrove self-assigned this May 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant