[SPARK-17526][Web UI]: Display the executor log links with the job failure message on Spark UI and Console

[zhzhan]

What changes were proposed in this pull request?

Add the executor log links with the job failure message on Spark UI and Console

How was this patch tested?

The patch is manually tested.

In Console:

ERROR TaskSetManager: Task 0 in stage 0.0 failed 4 times; stdout: stdout_log_link stderr: stderr_log_link; aborting job ...

In WebUI

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

[SparkQA]

Test build #65325 has finished for PR 15080 at commit 19fa189.

• This patch fails MiMa tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):
  • case class TaskSetFailed(taskSet: TaskSet, reason: String, exception: Option[Throwable],
  • case class WorkerOffer(executorId: String, host: String, cores: Int,

[SparkQA]

Test build #65332 has finished for PR 15080 at commit bcb7a2c.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[srowen]

This is a lot of plumbing, to push info specific to a resource manager down a few levels. I don't think it's worth it just for a log message.

[zhzhan]

@srowen Thanks for reviewing this. Any suggestion to improve it are welcomed. It does bother us a lot without being able to locate the debug log quickly in production.

[srowen]

I would prefer not to make this change and close this PR.