Skip to content

[SPARK-21287][SQL] Ability to use Integer.MIN_VALUE as a fetchSize - #18515

Closed
maver1ck wants to merge 1 commit into
apache:masterfrom
maver1ck:spark-21287
Closed

[SPARK-21287][SQL] Ability to use Integer.MIN_VALUE as a fetchSize#18515
maver1ck wants to merge 1 commit into
apache:masterfrom
maver1ck:spark-21287

Conversation

@maver1ck

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

FIX for https://issues.apache.org/jira/browse/SPARK-21287

How was this patch tested?

Existing automated tests + manual tests.

@maver1ckmaver1ck changed the title [SPARK-21287] Ability to use Integer.MIN_VALUE as a fetchSize[SPARK-21287][SQL] Ability to use Integer.MIN_VALUE as a fetchSizeJul 3, 2017
@srowen

Copy link
Copy Markdown
Member

See JIRA; I don't think we should allow this.

@SparkQA

Copy link
Copy Markdown

Test build #79100 has finished for PR 18515 at commit 97b6d7b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

val fetchSize = {
val size = parameters.getOrElse(JDBC_BATCH_FETCH_SIZE, "0").toInt
require(size >= 0,
require(size >= 0 || size == Integer.MIN_VALUE,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It does not make sense to the other data sources except MySQL. If needed, we can introduce a dialect specific checking APIs in JdbcDialect.scala

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 for @gatorsmile 's suggestion.

@gatorsmile

Copy link
Copy Markdown
Member

@maver1ck Any update?

@HyukjinKwonHyukjinKwon mentioned this pull request Jul 31, 2017
@SparkQA

Copy link
Copy Markdown

Test build #81467 has finished for PR 18515 at commit 97b6d7b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

srowen added a commit to srowen/spark that referenced this pull request Sep 12, 2017
@srowensrowen mentioned this pull request Sep 12, 2017
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 22, 2025
Closesapache#18522Closesapache#17722Closesapache#18879Closesapache#18891Closesapache#18806Closesapache#18948Closesapache#18949Closesapache#19070Closesapache#19039Closesapache#19142Closesapache#18515Closesapache#19154Closesapache#19162Closesapache#19187Closesapache#19091
Author: Sean Owen <sowen@cloudera.com>
Closesapache#19203 from srowen/CloseStalePRs3.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@maver1ck@srowen@SparkQA@gatorsmile@dongjoon-hyun