Skip to content

[SPARK-2228] change hard coded EVENT_QUEUE_CAPACITY to spark.liveListenerBus.eventQueueCapacity - #1257

Closed
bxshi wants to merge 1 commit into
apache:masterfrom
bxshi:SPARK-2228
Closed

[SPARK-2228] change hard coded EVENT_QUEUE_CAPACITY to spark.liveListenerBus.eventQueueCapacity#1257
bxshi wants to merge 1 commit into
apache:masterfrom
bxshi:SPARK-2228

Conversation

@bxshi

@bxshibxshi commented Jun 28, 2014

Copy link
Copy Markdown

change hard coded EVENT_QUEUE_CAPACITY to spark.liveListenerBus.eventQueueCapacity
https://issues.apache.org/jira/browse/SPARK-2228

@bxshi
fixSPARK-2228
2a9a1d4
change hard coded EVENT_QUEUE_CAPACITY to spark.liveListenerBus.eventQueueCapacity
@AmplabJenkins

AmplabJenkins commented Jun 28, 2014

Copy link
Copy Markdown

Can one of the admins verify this patch?

@bxshibxshi changed the title fix SPARK-2228[SPARK-2228] change hard coded EVENT_QUEUE_CAPACITY to spark.liveListenerBus.eventQueueCapacityJun 28, 2014
@pwendell

pwendell commented Jun 28, 2014

Copy link
Copy Markdown
Contributor

I commented on the JIRA, but I don't think this should be configurable. If someone overflows this buffer it means there program is not in steady state (the buffer is already really large at 10,000 events). We should instead improve the efficiency of the listeners so that programs cannot get into this state.

@pwendell

pwendell commented Aug 2, 2014

Copy link
Copy Markdown
Contributor

Okay we fixed the underlying issue in #1579 - would you mind closing this for now?

@andrewor14

andrewor14 commented Aug 25, 2014

Copy link
Copy Markdown
Contributor

@bxshi This is fixed in #1679. Would you mind closing this PR?

@bxshibxshi closed this Aug 25, 2014
@bxshi

bxshi commented Aug 25, 2014

Copy link
Copy Markdown
Author

Sure, np.

Baoxu Shi(Dash)
Computer Science and Engineering Department
University of Notre Dame

On Aug 25, 2014, at 3:26 PM, andrewor14 notifications@github.com wrote:

@bxshi This is fixed in #1679. Would you mind closing this PR?

—
Reply to this email directly or view it on GitHub.

wangyum added a commit that referenced this pull request May 26, 2023
@wangyumGitHub Enterprise
[CARMEL-6582][SPARK-42513][SQL] Push down topK through join (#1257)
f7c77ff
* Push down topK through join
* format
* fix
* fix
* Add tag
* Update Optimizer.scala
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@bxshi@AmplabJenkins@pwendell@andrewor14