Skip to content

[SPARK-20555][SQL] Fix mapping of Oracle DECIMAL types to Spark types - #17830

Closed
gaborfeher wants to merge 3 commits into
apache:masterfrom
gaborfeher:gaborfeher-oracle-dialect
Closed

[SPARK-20555][SQL] Fix mapping of Oracle DECIMAL types to Spark types#17830
gaborfeher wants to merge 3 commits into
apache:masterfrom
gaborfeher:gaborfeher-oracle-dialect

Conversation

@gaborfeher

@gaborfehergaborfeher commented May 2, 2017

Copy link
Copy Markdown

What changes were proposed in this pull request?

This change removes the custom code from OracleDialect, that was mapping some of Oracle's DECIMAL(X, Y) types to BooleanType, IntegerType, LongType or FloatType.

How was this patch tested?

I used the following command to run the docker-based integration tests:

./build/mvn -Pdocker-integration-tests -pl :spark-docker-integration-tests_2.11 test

@gatorsmile

Copy link
Copy Markdown
Member

ok to test

assert(values.getFloat(4).equals(doubleVal.toFloat))
assert(values.getInt(5).equals(byteVal.toInt))
assert(values.getInt(6).equals(shortVal.toInt))
assert(values.getDecimal(0).compareTo(BigDecimal.valueOf(booleanVal ? 1 : 0)) == 0)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This does not work. The conditional operator ? : is not supported by Scala.

@SparkQA

Copy link
Copy Markdown

Test build #77952 has finished for PR 17830 at commit 3f841c7.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile

Copy link
Copy Markdown
Member

ping @gaborfeher

@gaborfeher

Copy link
Copy Markdown
Author

Hi, thanks for the review! I definitely want to continue, but I'll only have more time to look into this next week. (I don't exactly know how I ended up with that broken test, because I was able to run some tests locally. I think, at least.)

@gatorsmile

Copy link
Copy Markdown
Member

This is a pretty serious bug. Let me resolve the failure as a separate PR. Will give all the credits to you when we merging the PR. Thank you for your fix!

@gaborfeher

Copy link
Copy Markdown
Author

Thank you, I am happy to see the issue is taken care of! (I don't know the customs here, we can also share the credit.)

asfgit pushed a commit that referenced this pull request Jun 24, 2017
… in read path
## What changes were proposed in this pull request?
This PR is to revert some code changes in the read path of #14377. The original fix is #17830
When merging this PR, please give the credit to gaborfeher
## How was this patch tested?
Added a test case to OracleIntegrationSuite.scala
Author: Gabor Feher <gabor.feher@lynxanalytics.com>
Author: gatorsmile <gatorsmile@gmail.com>
Closes#18408 from gatorsmile/OracleType.
(cherry picked from commit b837bf9)
Signed-off-by: gatorsmile <gatorsmile@gmail.com>
ghost pushed a commit to dbtsai/spark that referenced this pull request Jun 24, 2017
… in read path
## What changes were proposed in this pull request?
This PR is to revert some code changes in the read path of apache#14377. The original fix is apache#17830
When merging this PR, please give the credit to gaborfeher
## How was this patch tested?
Added a test case to OracleIntegrationSuite.scala
Author: Gabor Feher <gabor.feher@lynxanalytics.com>
Author: gatorsmile <gatorsmile@gmail.com>
Closesapache#18408 from gatorsmile/OracleType.
@gatorsmile

Copy link
Copy Markdown
Member

@gaborfeher Since the PR has been merged, could you please close it? Thanks!

asfgit pushed a commit that referenced this pull request Jun 24, 2017
… in read path
This PR is to revert some code changes in the read path of #14377. The original fix is #17830
When merging this PR, please give the credit to gaborfeher
Added a test case to OracleIntegrationSuite.scala
Author: Gabor Feher <gabor.feher@lynxanalytics.com>
Author: gatorsmile <gatorsmile@gmail.com>
Closes#18408 from gatorsmile/OracleType.
@gatorsmilegatorsmile mentioned this pull request Jun 27, 2017
robert3005 pushed a commit to palantir/spark that referenced this pull request Jun 29, 2017
… in read path
## What changes were proposed in this pull request?
This PR is to revert some code changes in the read path of apache#14377. The original fix is apache#17830
When merging this PR, please give the credit to gaborfeher
## How was this patch tested?
Added a test case to OracleIntegrationSuite.scala
Author: Gabor Feher <gabor.feher@lynxanalytics.com>
Author: gatorsmile <gatorsmile@gmail.com>
Closesapache#18408 from gatorsmile/OracleType.
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
## What changes were proposed in this pull request?
This PR proposes to close stale PRs, mostly the same instances with apache#18017
I believe the author in apache#14807 removed his account.
Closesapache#7075Closesapache#8927Closesapache#9202Closesapache#9366Closesapache#10861Closesapache#11420Closesapache#12356Closesapache#13028Closesapache#13506Closesapache#14191Closesapache#14198Closesapache#14330Closesapache#14807Closesapache#15839Closesapache#16225Closesapache#16685Closesapache#16692Closesapache#16995Closesapache#17181Closesapache#17211Closesapache#17235Closesapache#17237Closesapache#17248Closesapache#17341Closesapache#17708Closesapache#17716Closesapache#17721Closesapache#17937
Added:
Closesapache#14739Closesapache#17139Closesapache#17445Closesapache#18042Closesapache#18359
Added:
Closesapache#16450Closesapache#16525Closesapache#17738
Added:
Closesapache#16458Closesapache#16508Closesapache#17714
Added:
Closesapache#17830Closesapache#14742
## How was this patch tested?
N/A
Author: hyukjinkwon <gurwls223@gmail.com>
Closesapache#18417 from HyukjinKwon/close-stale-pr.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@gaborfeher@gatorsmile@SparkQA