Uh oh!
There was an error while loading. Please reload this page.
ZEPPELIN-256 Self diagnosis spark configuration - #246
Closed
Leemoonsoo wants to merge 43 commits into
Closed
Conversation
Leemoonsoo
commented
Aug 23, 2015
MemberAuthor
This branch rebased #244 |
Leemoonsooforce-pushed
the
spark_conf_validate
branch
from
August 23, 2015 01:55
9fb62ef to
3d77edeCompareLeemoonsoo
commented
Aug 23, 2015
MemberAuthor
Ready to be reviewed and merge. |
Contributor
There was a problem hiding this comment.
i think it should be something like xxxxxxx not found.
khalidhuseynov
commented
Aug 23, 2015
Member
That would be very helpful during Zeppelin set up! LGTM |
Member
There was a problem hiding this comment.
should we get SPARK_HOME like above (line 303):
getSystemDefault("SPARK_HOME", "spark.home", null);
Leemoonsooforce-pushed
the
spark_conf_validate
branch
from
September 1, 2015 00:37
1b714db to
e00f0f1CompareLeemoonsoo referenced
this pull request
in Leemoonsoo/zeppelin
Sep 5, 2015
felixcheung
commented
Mar 9, 2016
Member
Let's bring to up-to-date? |
lelou6666 pushed a commit
to lelou6666/incubator-zeppelin
that referenced
this pull request
Mar 25, 2016
add view only mode
corneadoug
commented
Sep 27, 2016
Contributor
@Leemoonsoo Any plan on finishing this one? |
asfgit pushed a commit
that referenced
this pull request
May 9, 2018
close#83close#86close#125close#133close#139close#146close#193close#203close#246close#262close#264close#273close#291close#299close#320close#347close#389close#413close#423close#543close#560close#658close#670close#728close#765close#777close#782close#783close#812close#822close#841close#843close#878close#884close#918close#989close#1076close#1135close#1187close#1231close#1304close#1316close#1361close#1385close#1390close#1414close#1422close#1425close#1447close#1458close#1466close#1485close#1492close#1495close#1497close#1536close#1545close#1561close#1577close#1600close#1603close#1678close#1695close#1739close#1748close#1765close#1767close#1776close#1783close#1799
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
https://issues.apache.org/jira/browse/ZEPPELIN-256
This patch adds capability of self diagnosis of configuration for spark interpreter.
User can set "zeppelin.spark.diagnosis" property "true" to enable this feature, in Interpreter page.
When it is turned on, SparkConfValidator checks validity of combination of environment variables and properties. It checks actual existence of specified directories (eg. SPARK_HOME, etc) and files (eg. pyspark.zip), according to given configuration.
When it detects some problem, it prints error as a result message in a notebook screen. So user can see what was missed.
Later, SparkConfValidator is proven to have no false positive, we can turn this feature on by default.