Uh oh!
There was an error while loading. Please reload this page.
SPARK-1469: Scheduler mode should accept lower-case definitions and have... - #388
SPARK-1469: Scheduler mode should accept lower-case definitions and have...#388techaddict wants to merge 1 commit into
Conversation
AmplabJenkins
commented
Apr 11, 2014
Can one of the admins verify this patch? |
techaddict
commented
Apr 12, 2014
@pwendell can you review this ? |
There was a problem hiding this comment.
This is a good start, but if you look at the JIRA, this exception won't actually echo back to the user the name they provided, which is bad form. I think you should capture the argument the user provided first then echo it back to them:
private val schedulingModeConf = conf.get("spark.scheduler.mode", "FIFO")
val schedulingMode: SchedulingMode = try {
SchedulingMode.withName(schedulingModeConf).toUpperCase)
} catch {
case e: java.util.NoSuchElementException =>
throw new SparkException(s"unrecognized spark.scheduler.mode: $schedulingModeConf")
}
Don't even bother re-sending the NoSuchElementException... it doesn't convey anything useful to the user.
…ave nicer error messages There are two improvements to Scheduler Mode: 1. Made the built in ones case insensitive (fair/FAIR, fifo/FIFO). 2. If an invalid mode is given we should print a better error message.
pwendell
commented
Apr 16, 2014
Jenkins, test this please. |
AmplabJenkins
commented
Apr 16, 2014
Merged build triggered. |
AmplabJenkins
commented
Apr 16, 2014
Merged build started. |
AmplabJenkins
commented
Apr 16, 2014
Merged build finished. All automated tests passed. |
AmplabJenkins
commented
Apr 16, 2014
All automated tests passed. |
pwendell
commented
Apr 16, 2014
Cool - thanks for this! |
pwendell
commented
Apr 16, 2014
I've merged this. |
…ave... ... nicer error messages There are two improvements to Scheduler Mode: 1. Made the built in ones case insensitive (fair/FAIR, fifo/FIFO). 2. If an invalid mode is given we should print a better error message. Author: Sandeep <sandeep@techaddict.me> Closes#388 from techaddict/1469 and squashes the following commits: a31bbd5 [Sandeep] SPARK-1469: Scheduler mode should accept lower-case definitions and have nicer error messages There are two improvements to Scheduler Mode: 1. Made the built in ones case insensitive (fair/FAIR, fifo/FIFO). 2. If an invalid mode is given we should print a better error message. (cherry picked from commit e269c24) Signed-off-by: Patrick Wendell <pwendell@gmail.com>
…ave... ... nicer error messages There are two improvements to Scheduler Mode: 1. Made the built in ones case insensitive (fair/FAIR, fifo/FIFO). 2. If an invalid mode is given we should print a better error message. Author: Sandeep <sandeep@techaddict.me> Closesapache#388 from techaddict/1469 and squashes the following commits: a31bbd5 [Sandeep] SPARK-1469: Scheduler mode should accept lower-case definitions and have nicer error messages There are two improvements to Scheduler Mode: 1. Made the built in ones case insensitive (fair/FAIR, fifo/FIFO). 2. If an invalid mode is given we should print a better error message.
…ernetes-g Branch 2.2 kubernetes
Change flavor to boot server in FusionCloud job
* KE-34191 replace partition Table path * change pom version
... nicer error messages
There are two improvements to Scheduler Mode: