Uh oh!
There was an error while loading. Please reload this page.
[SPARK-8841] [SQL] Fix partition pruning percentage log message - #7227
[SPARK-8841] [SQL] Fix partition pruning percentage log message#7227srlindemann wants to merge 1 commit into
Conversation
AmplabJenkins
commented
Jul 5, 2015
Can one of the admins verify this patch? |
squito
commented
Jul 5, 2015
Jenkins, ok to test |
squito
commented
Jul 5, 2015
lgtm |
rxin
commented
Jul 6, 2015
Jenkins, test this please. (Did something go wrong with Jenkins?) |
rxin
commented
Jul 6, 2015
cc @liancheng |
liancheng
commented
Jul 6, 2015
ok to test |
AmplabJenkins
commented
Jul 6, 2015
Merged build triggered. |
liancheng
commented
Jul 6, 2015
@srlindemann Thanks for fixing this! Could you please file a JIRA and change the PR title to "[SPARK-xxxx] [SQL] Fix partition pruning percentage log message"? |
srowen
commented
Jul 6, 2015
Is this even worth a JIRA? there is virtually no difference between the description and fix |
AmplabJenkins
commented
Jul 6, 2015
Merged build started. |
SparkQA
commented
Jul 6, 2015
Test build #36567 has started for PR 7227 at commit |
SparkQA
commented
Jul 6, 2015
Test build #36567 has finished for PR 7227 at commit
|
AmplabJenkins
commented
Jul 6, 2015
Merged build finished. Test PASSed. |
srlindemann
commented
Jul 6, 2015
I saw on one of the contrib pages that trivial changes might not have a
|
liancheng
commented
Jul 6, 2015
@srowen Hm, yeah, now I'd agree that this might not worth a JIRA. Anyway, filing one to track it does no harm :) @srlindemann Thanks! Merging to master. |
When pruning partitions for a query plan, a message is logged indicating what how many partitions were selected based on predicate criteria, and what percent were pruned.
The current release erroneously uses
1 - total/selectedto compute this quantity, leading to nonsense messages like "pruned -1000% partitions". The fix is simple and obvious.