Uh oh!
There was an error while loading. Please reload this page.
[SPARK-52967][BUILD] Upgrade ORC to 2.2.0 - #51676
Conversation
dongjoon-hyun
left a comment
There was a problem hiding this comment.
Thank you, @williamhyun .
mishuhaque
commented
Jul 27, 2025
Thanks for the update! Good to see support for new ORC features like Geometry types and zstd strategy. The dependency version bump looks clean and scoped, and I appreciate that it's well documented with the ORC release notes. Just curious — does this change require any downstream update to Spark’s DataSourceV2 readers? |
No, Apache ORC community follows |
HyukjinKwon
left a comment
There was a problem hiding this comment.
LGTM pending CI and release
dongjoon-hyun
commented
Jul 30, 2025
Thank you, @williamhyun and all. Merged to master for Apache Spark 4.1.0. |
…ark 4.1 (#11313) * [Fix] Remove `@NotNull` annotations to resolve dependency issues caused by ORC upgrade. apache/spark#51676 * [Fix] Make `reserveNewColumn` public in `ArrowWritableColumnVector` and `WritableColumnVectorShim` In Java, an overriding method's access modifier cannot be more restrictive than the overridden method. Changing from protected to public is safe and ensures compatibility before the Spark version upgrade. see apache/spark#52557 * [Fix] Add GeographyVal and GeometryVal support in ArrowColumnarRow, BatchCarrierRow and ColumnarToCarrierRowExecBase see [SPIP: Add geospatial types in Spark](https://issues.apache.org/jira/browse/SPARK-51658) * [Fix] Update commons-collections to version 4.5.0. see apache/spark#52743 * [Fix] Enable SPARK_TESTING environment variable for Spark test jobs see apache/spark#53344
What changes were proposed in this pull request?
This PR aims to upgrade ORC to 2.2.0. 2.2.0 RC1 is currently under voting.
Why are the changes needed?
Apache ORC 2.2.0 is a new feature release.
GeometryandGeographytypes orc#2032orc.compression.zstd.strategyorc#2338GeometryandGeographytypes orc#2269Mesonbuild orc#2249Does this PR introduce any user-facing change?
No.
How was this patch tested?
Pass the CIs.
Was this patch authored or co-authored using generative AI tooling?
No.