Skip to content

[SPARK-24529][Build][test-maven][follow-up] Add spotbugs 3.1.6 into maven build process - #21994

Closed
kiszk wants to merge 1 commit into
apache:masterfrom
kiszk:SPARK-24529-follow
Closed

[SPARK-24529][Build][test-maven][follow-up] Add spotbugs 3.1.6 into maven build process#21994
kiszk wants to merge 1 commit into
apache:masterfrom
kiszk:SPARK-24529-follow

Conversation

@kiszk

@kiszkkiszk commented Aug 3, 2018

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

This PR tries to add spotbugs after upgrading mvn. This is because we met a problem with old mvn.

How was this patch tested?

existing UTs

@SparkQA

Copy link
Copy Markdown

Test build #94177 has finished for PR 21994 at commit 3501209.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon

Copy link
Copy Markdown
Member

retest this please

@HyukjinKwon

Copy link
Copy Markdown
Member

cc @yhuai too

@SparkQA

Copy link
Copy Markdown

Test build #94197 has finished for PR 21994 at commit 3501209.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon

Copy link
Copy Markdown
Member

retest this please

@SparkQA

Copy link
Copy Markdown

Test build #94210 has finished for PR 21994 at commit 3501209.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Comment threadpom.xml
</plugin>
<plugin>
<groupId>com.github.spotbugs</groupId>
<artifactId>spotbugs-maven-plugin</artifactId>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, after having this plugin, I were unable to perform parallel builds.

https://cwiki.apache.org/confluence/display/MAVEN/Parallel+builds+in+Maven+3

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It sounds like this plug in is not thread safe.

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, I have not tried this with parallel build. Spotbugs looks non MT-safe

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding spotbugs slows down my local build a lot. Can we hold this?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yea, this slows down 16ish mins and that was my concern at the very first place. Currently, it only affects Maven build though. +1 for holding on for now.

Copy link
Copy Markdown
MemberAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let me check the elapsed time on my environment. +1 for holding on for now.

@srowensrowen mentioned this pull request Nov 10, 2018
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
Closesapache#21766Closesapache#21679Closesapache#21161Closesapache#20846Closesapache#19434Closesapache#18080Closesapache#17648Closesapache#17169
Add:
Closesapache#22813Closesapache#21994Closesapache#22005Closesapache#22463
Add:
Closesapache#15899
Add:
Closesapache#22539Closesapache#21868Closesapache#21514Closesapache#21402Closesapache#21322Closesapache#21257Closesapache#20163Closesapache#19691Closesapache#18697Closesapache#18636Closesapache#17176Closesapache#23001 from wangyum/CloseStalePRs.
Authored-by: Yuming Wang <yumwang@ebay.com>
Signed-off-by: hyukjinkwon <gurwls223@apache.org>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@kiszk@SparkQA@HyukjinKwon@gatorsmile