Upgrade to arrow 59#64
Open
adriangb wants to merge 1 commit into
Open
Conversation
Bump arrow, arrow-schema, arrow-cast and the parquet-variant crates to 59.0.0. DataFusion does not yet have a crates.io release built against arrow 59, so a [patch.crates-io] section points the datafusion* crates at apache/datafusion PR #22744 (alamb/update_arrow_59), which updates DataFusion to arrow/parquet 59.0.0. This keeps the whole dependency graph on a single arrow 59 major; drop the patch once a DataFusion release ships arrow 59. parquet-variant 59 changed `variant_get(..., as_type)` to coerce mismatched primitives (matching SQL cast semantics) instead of returning NULL: - numeric -> boolean coerces nonzero to true - float -> integer truncates toward zero Update the affected unit tests and sqllogictests accordingly. https://claude.ai/code/session_01H3jbXkVZam7VH5DpiXczBR
Contributor
I think there should be more stuff to add here that I'm missing |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bump arrow, arrow-schema, arrow-cast and the parquet-variant crates to 59.0.0. DataFusion does not yet have a crates.io release built against arrow 59, so a [patch.crates-io] section points the datafusion* crates at apache/datafusion PR #22744 (alamb/update_arrow_59), which updates DataFusion to arrow/parquet 59.0.0. This keeps the whole dependency graph on a single arrow 59 major; drop the patch once a DataFusion release ships arrow 59.
parquet-variant 59 changed
variant_get(..., as_type)to coerce mismatched primitives (matching SQL cast semantics) instead of returning NULL:Update the affected unit tests and sqllogictests accordingly.