Uh oh!
There was an error while loading. Please reload this page.
[SPARK-6967] [SQL] fix date type convertion in jdbcrdd - #5590
[SPARK-6967] [SQL] fix date type convertion in jdbcrdd#5590adrian-wang wants to merge 2 commits into
Conversation
SparkQA
commented
Apr 20, 2015
Test build #30581 has finished for PR 5590 at commit
|
marmbrus
commented
Apr 21, 2015
Could we add a unit test in |
SparkQA
commented
Apr 22, 2015
Test build #30727 has finished for PR 5590 at commit
|
rxin
commented
Apr 23, 2015
Merging in master and branch-1.3. |
This pr convert java.sql.Date type into Int for JDBCRDD. Author: Daoyuan Wang <daoyuan.wang@intel.com> Closes#5590 from adrian-wang/datebug and squashes the following commits: f897b81 [Daoyuan Wang] add a test case 3c9184c [Daoyuan Wang] fix date type convertion in jdbcrdd (cherry picked from commit 04525c0) Signed-off-by: Reynold Xin <rxin@databricks.com> Conflicts: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala
This pr convert java.sql.Date type into Int for JDBCRDD. Author: Daoyuan Wang <daoyuan.wang@intel.com> Closesapache#5590 from adrian-wang/datebug and squashes the following commits: f897b81 [Daoyuan Wang] add a test case 3c9184c [Daoyuan Wang] fix date type convertion in jdbcrdd (cherry picked from commit 04525c0) Signed-off-by: Reynold Xin <rxin@databricks.com> Conflicts: sql/core/src/main/scala/org/apache/spark/sql/jdbc/JDBCRDD.scala
nadavoosh
commented
Apr 30, 2015
hi @adrian-wang ! I am using spark and needed to include this fix, since I am reading from a table that has Date types. I rebuilt spark with this change & it works well. I just ran into a new problem though: when the Date field has null values, spark throws a java.lang.NullPointerException Thank you for your help! |
adrian-wang
commented
Apr 30, 2015
@nadavoosh Thanks for your feedback! I will take a look at this soon. |
nadavoosh
commented
May 2, 2015
@adrian-wang this worked for me: |
This pr convert java.sql.Date type into Int for JDBCRDD. Author: Daoyuan Wang <daoyuan.wang@intel.com> Closesapache#5590 from adrian-wang/datebug and squashes the following commits: f897b81 [Daoyuan Wang] add a test case 3c9184c [Daoyuan Wang] fix date type convertion in jdbcrdd
Thank nadavoosh point this out in apache#5590 Author: Daoyuan Wang <daoyuan.wang@intel.com> Closesapache#5877 from adrian-wang/jdbcrdd and squashes the following commits: cc11900 [Daoyuan Wang] avoid NPE in jdbcrdd
Thank nadavoosh point this out in apache#5590 Author: Daoyuan Wang <daoyuan.wang@intel.com> Closesapache#5877 from adrian-wang/jdbcrdd and squashes the following commits: cc11900 [Daoyuan Wang] avoid NPE in jdbcrdd
This pr convert java.sql.Date type into Int for JDBCRDD. Author: Daoyuan Wang <daoyuan.wang@intel.com> Closesapache#5590 from adrian-wang/datebug and squashes the following commits: f897b81 [Daoyuan Wang] add a test case 3c9184c [Daoyuan Wang] fix date type convertion in jdbcrdd
Thank nadavoosh point this out in apache#5590 Author: Daoyuan Wang <daoyuan.wang@intel.com> Closesapache#5877 from adrian-wang/jdbcrdd and squashes the following commits: cc11900 [Daoyuan Wang] avoid NPE in jdbcrdd
This pr convert java.sql.Date type into Int for JDBCRDD.