Skip to content

[SPARK-21168] KafkaRDD should always set kafka clientId. - #19887

Closed
liu-zhaokun wants to merge 1 commit into
apache:masterfrom
liu-zhaokun:master1205
Closed

[SPARK-21168] KafkaRDD should always set kafka clientId.#19887
liu-zhaokun wants to merge 1 commit into
apache:masterfrom
liu-zhaokun:master1205

Conversation

@liu-zhaokun

@liu-zhaokunliu-zhaokun commented Dec 5, 2017

Copy link
Copy Markdown
Contributor

https://issues.apache.org/jira/browse/SPARK-21168
There are no a number of other places that a client ID should be set,and I think we should use consumer.clientId in the clientId method,because the fetch request will be used by the same consumer behind.

@liu-zhaokun

Copy link
Copy Markdown
ContributorAuthor

Can one of the admins verify this patch?

@SparkQA

Copy link
Copy Markdown

Test build #4153 has finished for PR 19887 at commit 5071789.

  • This patch fails PySpark unit tests.
  • This patch does not merge cleanly.
  • This patch adds no public classes.

@srowen

Copy link
Copy Markdown
Member

Seems reasonable; maybe @koeninger has a thought

@koeninger

Copy link
Copy Markdown
Contributor

Jenkins, retest this please

@koeninger

Copy link
Copy Markdown
Contributor

Seems ok to me, long as it passes retest

@SparkQA

Copy link
Copy Markdown

Test build #89733 has finished for PR 19887 at commit 5071789.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@koeninger

Copy link
Copy Markdown
Contributor

Merging to master, thanks @liu-zhaokun

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@liu-zhaokun@SparkQA@srowen@koeninger