[Spark-3490] Disable SparkUI for tests (backport into 0.9)

[andrewor14]

Branch-1.2 #2363 (original)
Branch-1.1 #2415
Branch-1.0 #3959
Branch-0.9 #3961 (this PR)

[SparkQA]

Test build #25278 has started for PR 3961 at commit 8644997.

• This patch merges cleanly.

[SparkQA]

Test build #25278 has finished for PR 3961 at commit 8644997.

• This patch fails some tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25278/
Test FAILed.

[andrewor14]

python tests are failing, but normal tests now pass. Jenkins retest this please

[SparkQA]

Test build #25280 has started for PR 3961 at commit 8644997.

• This patch merges cleanly.

[SparkQA]

Test build #25280 has finished for PR 3961 at commit 8644997.

• This patch fails some tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25280/
Test FAILed.

[andrewor14]

retest this please, we just merged the fix for python tests

[SparkQA]

Test build #25328 has started for PR 3961 at commit 8644997.

• This patch merges cleanly.

[SparkQA]

Test build #25328 has finished for PR 3961 at commit 8644997.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/25328/
Test PASSed.

[andrewor14]

Yes!! Finally I'm merging this thanks.