[SPARK-26212][Build][test-maven] Upgrade maven version to 3.6.0

[kiszk]

What changes were proposed in this pull request?

This PR updates maven version from 3.5.4 to 3.6.0. The release note of the 3.6.0 is here.

From the release note of the 3.6.0, the followings are new features:

1. There had been issues related to the project discoverytime which has been increased in previous version which influenced some of our users.
2. The output in the reactor summary has been improved.
3. There was an issue related to the classpath ordering.

How was this patch tested?

Existing tests

[SparkQA]

Test build #99437 has finished for PR 23177 at commit a5587b5.

• This patch fails from timeout after a configured wait of 400m.
• This patch merges cleanly.
• This patch adds no public classes.

[kiszk]

retest this please

[srowen]

That's fine but we need to also update build/mvn to download and use the same version.

[kiszk]

I thought that it is automatically done by build/mvn, as you pointed out before.

[SparkQA]

Test build #99464 has finished for PR 23177 at commit a5587b5.

• This patch fails Spark unit tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

Ah, that's the second time I've forgotten this. Yes looks good to me.

[SparkQA]

Test build #4447 has finished for PR 23177 at commit a5587b5.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[HyukjinKwon]

@kiszk, I think we should update here as well https://github.com/apache/spark/blob/master/docs/building-spark.md#apache-maven (see #22781)

[srowen]

That wouldn't hurt, though I suspect the project continues to build with Maven 3.5.4 for a long while.

[dongjoon-hyun]

+1 for updating the doc, too.

[HyukjinKwon]

adding @dongjoon-hyun

[dongjoon-hyun]

Thank you for pinging me, @HyukjinKwon .

[dongjoon-hyun]

LGTM except for the doc issue.
I also tested with Scala-2.11 Maven for safety. It looks okay.

[dongjoon-hyun]

Oh, @kiszk . Could you update AppVoyer script together? AppVoyer script still uses a static version number unlike with build/mvn.

• https://github.com/apache/spark/blob/master/dev/appveyor-install-dependencies.ps1#L84

[kiszk]

Sure, updated. Thanks for letting know them.

[SparkQA]

Test build #99538 has finished for PR 23177 at commit aa25833.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

Merging to master. I've been using 3.6.0 on the command line for a while and it's fine. Note that if you use your local mvn in IntelliJ, it seems to have some incompatibility with the current latest 2018.13.1 release. It's no big deal, falling back to its internal 3.3.9 version works fine.