Uh oh!
There was an error while loading. Please reload this page.
[SPARK-56134][SQL] Make BufferedRowIterator.unsafeRow public to avoid IllegalAccessError. - #54942
[SPARK-56134][SQL] Make BufferedRowIterator.unsafeRow public to avoid IllegalAccessError.#54942chenhao-db wants to merge 1 commit into
Conversation
chenhao-db
commented
Mar 23, 2026
@viirya@hvanhovell@rednaxelafx could you take a look? Thanks! |
rednaxelafx
commented
Mar 24, 2026
Looks good (not official Apache Spark reviewer). The PR description mentioned that the |
chenhao-db
commented
Apr 29, 2026
@HyukjinKwon could you help merge it? Thanks! |
HyukjinKwon
commented
Apr 29, 2026
Merged to master. |
What changes were proposed in this pull request?
This is very similar to #20779. When a generated code has split classes and they try to access protected fields in
BufferedRowIterator, anIllegalAccessErrorwill happen.I am not making
partitionIndexpublic too because I cannot find a real example that can trigger anIllegalAccessErroron it too. In the code base,partitionIndexis mostly accessed viaaddPartitionInitializationStatement. Since it is used in the partition initialization code, not in split classes, there should be no issue with it.Why are the changes needed?
Fix runtime error in large queries.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Unit test.
Was this patch authored or co-authored using generative AI tooling?
No.