Skip to content

[SPARK-55841][BUILD][FOLLOWUP] Update SparkBuild.scala consistently - #54633

Closed
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-55841-2
Closed

[SPARK-55841][BUILD][FOLLOWUP] Update SparkBuild.scala consistently#54633
dongjoon-hyun wants to merge 1 commit into
apache:masterfrom
dongjoon-hyun:SPARK-55841-2

Conversation

@dongjoon-hyun

@dongjoon-hyundongjoon-hyun commented Mar 5, 2026

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR aims to update the default value of fasterxml.jackson.version in SparkBuild.scala consistently.

Why are the changes needed?

Although we update Jackson to 2.21.x already, Sparkbuild.scala has outdated value like the following.

lazyvaljacksonVersion= sys.props.get("fasterxml.jackson.version").getOrElse("2.20.1")

MAVEN

$ mvn dependency:tree | grep jackson-annotations | sort | uniq
[INFO] +- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile
[INFO] | | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile
[INFO] | \- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile
[INFO] | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile
[INFO] | | \- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile
[INFO] | | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile
[INFO] | | | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile
[INFO] | | | | +- com.fasterxml.jackson.core:jackson-annotations:jar:2.21:compile

SBT

$ build/sbt dependencyTree | grep jackson-annotations
Using SPARK_LOCAL_IP=localhost
[info] | +-com.fasterxml.jackson.core:jackson-annotations:2.20
[info] | +-com.fasterxml.jackson.core:jackson-annotations:2.20
[info] | +-com.fasterxml.jackson.core:jackson-annotations:2.20
[info] | +-com.fasterxml.jackson.core:jackson-annotations:2.20
...

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Gemini 3.1 Pro (High) on Antigravity.

@dongjoon-hyun

Copy link
Copy Markdown
MemberAuthor

Could you review this PR, @LuciferYang ?

@dongjoon-hyun

dongjoon-hyun commented Mar 5, 2026

Copy link
Copy Markdown
MemberAuthor

Thank you, @yaooqinn !

Currently, the clean sbt build seems to fail.

$ build/sbt package
...
[error] lmcoursier.internal.shaded.coursier.error.FetchError$DownloadingArtifacts: Error fetching artifacts:
[error] file:/Users/dongjoon/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.20/jackson-annotations-2.20.jar: not found: /Users/dongjoon/.m2/repository/com/fasterxml/jackson/core/jackson-annotations/2.20/jackson-annotations-2.20.jar

@dongjoon-hyun

Copy link
Copy Markdown
MemberAuthor

Merged to master.

@dongjoon-hyun
dongjoon-hyun deleted the SPARK-55841-2 branch March 5, 2026 06:49
@LuciferYang

Copy link
Copy Markdown
Contributor

late LGTM

@dongjoon-hyun

Copy link
Copy Markdown
MemberAuthor

Thank you, @LuciferYang !

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@dongjoon-hyun@LuciferYang@yaooqinn