Skip to content

ARROW-12421: [Rust] [DataFusion] Disable repartition rule - #10069

Closed
andygrove wants to merge 1 commit into
apache:masterfrom
andygrove:remove-repartition
Closed

ARROW-12421: [Rust] [DataFusion] Disable repartition rule#10069
andygrove wants to merge 1 commit into
apache:masterfrom
andygrove:remove-repartition

Conversation

@andygrove

Copy link
Copy Markdown
Member

Remove repartition rule to fix test regression when running on 24 core threadripper CPU.

This will need further investigation but this patch is needed for the 4.0.0 release.

@alambalamb changed the title ARROW-12421: [Rust] [DataFusion] Remove repartition ruleARROW-12421: [Rust] [DataFusion] Disable repartition ruleApr 16, 2021

@alambalamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest we also file a ticket (I can do so if you would like) to investigate and re-enable this optimization

@github-actions

Copy link
Copy Markdown

@DandandanDandandan left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @andygrove !

@andygrove

Copy link
Copy Markdown
MemberAuthor

I suggest we also file a ticket (I can do so if you would like) to investigate and re-enable this optimization

That would be great. Thanks.

@jorgecarleitaojorgecarleitao left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agreed. Thanks for the quick fix on this!

@alambalamb closed this in 9c1e5bdApr 16, 2021
@alamb

alamb commented Apr 16, 2021

Copy link
Copy Markdown
Contributor

Additional discussion on ASF slack is here: https://the-asf.slack.com/archives/C01QUFS30TD/p1618578254185400 may be related to #9865

@alamb

Copy link
Copy Markdown
Contributor

Filed https://issues.apache.org/jira/browse/ARROW-12427 to track reenabling this optimization rule

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@andygrove@alamb@Dandandan@jorgecarleitao