Uh oh!
There was an error while loading. Please reload this page.
[SPARK-17773] [Input/Output] Add VoidObjectInspector - #15337
Conversation
hvanhovell
commented
Oct 4, 2016
ok to test |
@seyfe This seems like a good idea. Could you add a little test to see if this is working? |
SparkQA
commented
Oct 4, 2016
Test build #66290 has finished for PR 15337 at commit
|
seyfe
commented
Oct 4, 2016
@hvanhovell. Thanks for the suggestion. Updated the HiveInspectorSuite, so 3 tests failed with below error: After applying the fix, all HiveInspectorSuite tests passed. |
SparkQA
commented
Oct 4, 2016
Test build #66299 has finished for PR 15337 at commit
|
rxin
commented
Oct 4, 2016
Thanks - merging in master/2.0. |
rxin
commented
Oct 4, 2016
Actually there is a conflict with back porting this into branch-2.0. Do you mind making a pull request against branch-2.0 too? |
Added VoidObjectInspector to the list of PrimitiveObjectInspectors (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) Executing following query was failing. select SOME_UDAF*(a.arr) from ( select Array(null) as arr from dim_one_row ) a After the fix, I am getting the correct output: res0: Array[org.apache.spark.sql.Row] = Array([null]) Author: Ergin Seyfe <eseyfe@fb.com> Closesapache#15337 from seyfe/add_void_object_inspector.
seyfe
commented
Oct 4, 2016
This is the PR for branch2.0: PR #15337 Added VoidObjectInspector to the list of PrimitiveObjectInspectors (Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests) Executing following query was failing. select SOME_UDAF*(a.arr) from ( select Array(null) as arr from dim_one_row ) a After the fix, I am getting the correct output: res0: Array[org.apache.spark.sql.Row] = Array([null]) Author: Ergin Seyfe <eseyfefb.com> Closes#15337 from seyfe/add_void_object_inspector. Author: Ergin Seyfe <eseyfe@fb.com> Closes#15345 from seyfe/add_void_object_inspector_2.0.
What changes were proposed in this pull request?
Added VoidObjectInspector to the list of PrimitiveObjectInspectors
How was this patch tested?
(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)
Executing following query was failing.
select SOME_UDAF*(a.arr)
from (
select Array(null) as arr from dim_one_row
) a
After the fix, I am getting the correct output:
res0: Array[org.apache.spark.sql.Row] = Array([null])