Uh oh!
There was an error while loading. Please reload this page.
[SPARK-2580] [PySpark] keep silent in worker if JVM close the socket - #1625
[SPARK-2580] [PySpark] keep silent in worker if JVM close the socket#1625davies wants to merge 2 commits into
Conversation
SparkQA
commented
Jul 29, 2014
QA tests have started for PR 1625. This patch merges cleanly. |
SparkQA
commented
Jul 29, 2014
QA results for PR 1625: |
rxin
commented
Jul 29, 2014
SparkQA
commented
Jul 29, 2014
QA tests have started for PR 1625. This patch merges cleanly. |
JoshRosen
commented
Jul 29, 2014
I've merged this into |
davies
commented
Jul 29, 2014
@JoshRosen did it include the last commit? I didn't find them in master nor branch-1.0. It's delayed? |
JoshRosen
commented
Jul 29, 2014
@davies Yeah, it included both commits. If you check the Apache repo, you should see the commits, but the GitHub mirroring is currently lagging behind. |
SparkQA
commented
Jul 29, 2014
QA results for PR 1625: |
mattf
commented
Jul 29, 2014
+1 lgtm, validated |
During rdd.take(n), JVM will close the socket if it had got enough data, the Python worker should keep silent in this case. In the same time, the worker should not print the trackback into stderr if it send the traceback to JVM successfully. Author: Davies Liu <davies.liu@gmail.com> Closes#1625 from davies/error and squashes the following commits: 4fbcc6d [Davies Liu] disable log4j during testing when exception is expected. cc14202 [Davies Liu] keep silent in worker if JVM close the socket (cherry picked from commit ccd5ab5) Signed-off-by: Josh Rosen <joshrosen@apache.org>
During rdd.take(n), JVM will close the socket if it had got enough data, the Python worker should keep silent in this case. In the same time, the worker should not print the trackback into stderr if it send the traceback to JVM successfully. Author: Davies Liu <davies.liu@gmail.com> Closesapache#1625 from davies/error and squashes the following commits: 4fbcc6d [Davies Liu] disable log4j during testing when exception is expected. cc14202 [Davies Liu] keep silent in worker if JVM close the socket
During rdd.take(n), JVM will close the socket if it had got enough data, the Python worker should keep silent in this case.
In the same time, the worker should not print the trackback into stderr if it send the traceback to JVM successfully.