Uh oh!
There was an error while loading. Please reload this page.
[SPARK-24639][DOC] Add three config in the doc - #21624
Conversation
| <td><code>spark.python.task.killTimeout</code></td> | ||
| <td>2s</td> | ||
| <td> | ||
| How long to wait before killing the python worker if a task cannot be interrupted. |
There was a problem hiding this comment.
"Timeout to wait before killing the python worker when a task cannot be interrupted."
There was a problem hiding this comment.
updated and fix confilct, please have a review, thanks, @zsxwing@jiangxb1987
jiangxb1987
commented
Jun 26, 2018
cc @zsxwing |
HyukjinKwon
commented
Jul 16, 2018
ok to test |
SparkQA
commented
Jul 16, 2018
Test build #93064 has finished for PR 21624 at commit
|
srowen
left a comment
There was a problem hiding this comment.
Not every config property is meant to be exposed to users. The sql ones have documentation in the source code, which leads me to believe they are OK to document publicly. The rest do not; they may be more internal or experimental configs to change. It's not wrong to document them, but it kind of means guaranteeing they will persist. The conservative thing would be to restrict this to the sql properties.
| </td> | ||
| </tr> | ||
| <tr> | ||
| <td><code>spark.sql.repl.eagerEval.truncate</code></td> |
There was a problem hiding this comment.
spark.sql.* configs should be in sql-programming-guide.md
| </td> | ||
| </tr> | ||
| <tr> | ||
| <td><code>spark.worker.driverTerminateTimeout</code></td> |
There was a problem hiding this comment.
Likewise spark.worker.* configs are in spark-standalone.md, it appears
Closesapache#16411Closesapache#21870Closesapache#21794Closesapache#21610Closesapache#21961Closesapache#21940Closesapache#21870Closesapache#22118Closesapache#21624Closesapache#19528Closesapache#18424Closesapache#22159 from srowen/Stale. Authored-by: Sean Owen <sean.owen@databricks.com> Signed-off-by: Sean Owen <sean.owen@databricks.com>
What changes were proposed in this pull request?
add three config which are mentioned in the pr #21567 , they are
spark.python.task.killTimeout,spark.worker.driverTerminateTimeoutandspark.ui.consoleProgress.update.intervalHow was this patch tested?
doc build