Uh oh!
There was an error while loading. Please reload this page.
[SPARK-6975][Yarn] Fix argument validation error - #5551
Conversation
There was a problem hiding this comment.
enabled -> enabled. I think this is simpler to state as "Number of executors was $numExecutors, but must be at least 1 (or 0 if dynamic executor allocation is enabled)."
There was a problem hiding this comment.
OK, I will change the statement.
SparkQA
commented
Apr 17, 2015
Test build #30466 has finished for PR 5551 at commit
|
SparkQA
commented
Apr 17, 2015
Test build #30471 has finished for PR 5551 at commit
|
srowen
commented
Apr 17, 2015
Jenkins, retest this please. |
SparkQA
commented
Apr 17, 2015
Test build #30481 has finished for PR 5551 at commit
|
vanzin
commented
Apr 17, 2015
Looks fine to me. Seems like it might be useful (and easy) to have different messages for each case, but not a big deal. |
andrewor14
commented
Apr 18, 2015
This looks fine. The previous setting was very confusing to the user because they would have run into this by following the docs. Thanks for fixing this I'm merging this into master and 1.3 |
`numExecutors` checking is failed when dynamic allocation is enabled with default configuration. Details can be seen is [SPARK-6975](https://issues.apache.org/jira/browse/SPARK-6975). sryza, please help me to review this, not sure is this the correct way, I think previous you change this part :) Author: jerryshao <saisai.shao@intel.com> Closes#5551 from jerryshao/SPARK-6975 and squashes the following commits: 4335da1 [jerryshao] Change according to the comments 77bdcbd [jerryshao] Fix argument validation error (cherry picked from commit d850b4b) Signed-off-by: Andrew Or <andrew@databricks.com>
numExecutorschecking is failed when dynamic allocation is enabled with default configuration. Details can be seen is SPARK-6975. @sryza, please help me to review this, not sure is this the correct way, I think previous you change this part :)