[SPARK-12351][MESOS]Add documentation about submitting Spark with mesos cluster mode.

[tnachen]

Adding more documentation about submitting jobs with mesos cluster mode.

[tnachen]

@andrewor14

[andrewor14]

do they know at this point what a MesosClusterDispatcher is?

[andrewor14]

@tnachen can you update this assuming the user doesn't know anything about the dispatcher?

[andrewor14]

looks alright

[SparkQA]

Test build #47028 has finished for PR 10086 at commit 448d706.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[andrewor14]

@dragos you mentioned you had difficulty running mesos in cluster mode. Does this additional documentation help? What were the issues you ran into?

[tnachen]

@andrewor14 I don't tihnk this doc helps his problem, he's running into issues where Spark configuration is not being passed down. I'm pushing a new update here.

[SparkQA]

Test build #47158 has finished for PR 10086 at commit 5d612d0.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[tnachen]

@andrewor14 pushed an update today, PTAL

[dragos]

Thanks, this is a good example! Can you please update also running-on-mesos.md, that part is where most people running on Mesos will look first. I think an example like this one, and one showing how to start the dispatcher would be great.

[dragos]

@andrewor14 the issue in the other PR is not due to missing docs, unfortunately. I will post my errors in that PR (I reached out to Tim via Slack earlier, but maybe it makes sense to have such discussions in the open)

[tnachen]

@dragos just updated the docs

[SparkQA]

Test build #47318 has finished for PR 10086 at commit 952f116.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):\n * If you like to run the MesosClusterDispatcher with Marathon, you need to run the MesosClusterDispatcher in the foreground (i.e:bin/spark-class org.apache.spark.deploy.mesos.MesosClusterDispatcher).\n

[dragos]

LGTM

[srowen]

Nits: "an daemon" -> "a daemon", url -> URL, "i.e" -> "i.e.". You might back-tick MesosClusterDispatcher too.

[andrewor14]

yeah, I would backtick the dispatcher

[andrewor14]

@tnachen can you address the comments? I'll merge this once you do so.

[srowen]

Ping @tnachen

[tnachen]

@srowen@andrewor14 sorry for the delay, it's updated now.

[SparkQA]

Test build #47741 has finished for PR 10086 at commit 7f8d7b6.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds the following public classes (experimental):\n * If you like to run theMesosClusterDispatcherwith Marathon, you need to run theMesosClusterDispatcherin the foreground (i.e:bin/spark-class org.apache.spark.deploy.mesos.MesosClusterDispatcher).\n

[srowen]

Last but not least, should we go ahead and make a JIRA for this? it's pretty minor but not trivial

[tnachen]

Created jira and updated title @srowen

[andrewor14]

Merged into master and 1.6