Uh oh!
There was an error while loading. Please reload this page.
[SPARK-18271][SQL]hash udf in HiveSessionCatalog.hiveFunctions is redundant - #15766
[SPARK-18271][SQL]hash udf in HiveSessionCatalog.hiveFunctions is redundant#15766windpiger wants to merge 1 commit into
Conversation
cloud-fan
commented
Nov 4, 2016
ok to test |
cloud-fan
commented
Nov 4, 2016
LGTM |
SparkQA
commented
Nov 4, 2016
Test build #68138 has finished for PR 15766 at commit
|
andrewor14
commented
Nov 4, 2016
retest this please |
SparkQA
commented
Nov 4, 2016
Test build #68152 has finished for PR 15766 at commit
|
Don't we actually unregister the Spark built-in one when testing Hive? |
cloud-fan
commented
Nov 5, 2016
@rxin good catch! We do unregister the spark builtin hash in test: https://github.com/apache/spark/blob/master/sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala#L60-L61 So we have a little more work to do here, we should register the hive hash function in that test suite. |
gatorsmile
commented
Nov 5, 2016
I am working on the related issue in #14498 |
windpiger
commented
Nov 5, 2016
@rxin@cloud-fan you are rigth,hash should be unregistered and replace with Hive's hash, or we could put the failed hash testcase into blacklist as @gatorsmile 's work #14498 . I will close the PR |
windpiger
commented
Nov 5, 2016
@cloud-fan I will appreciate that you can help to close this PR~ |
cloud-fan
commented
Nov 5, 2016
Only the owner(yourself) can close this PR. |
What changes were proposed in this pull request?
when lookupfunction in HiveSessionCatalog, first look up in spark's build-in functionRegistry, if it not existed, then look up the Hive'S build-in functions which are listed in Seq(hiveFunctions).
But the [hash] function is already in spark's build-in functionRegistry list, so it will never to go to look up in Hive's hiveFunctions list, so the [hash] function which is in Hive's hiveFunctions is redundant, we can remove it.