Skip to content

test: re-enable window function over parquet with forced collisions - #11939

Merged
alamb merged 2 commits into
apache:mainfrom
korowa:parquet-hash-collisions
Aug 14, 2024
Merged

test: re-enable window function over parquet with forced collisions#11939
alamb merged 2 commits into
apache:mainfrom
korowa:parquet-hash-collisions

Conversation

@korowa

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Closes#11660.

Rationale for this change

After several attempts to reproduce the failure locally and in fork CI it still was not reproducing. Also I wasn't able to find any workflow failure related to 1.80 upgrade in PRs and on main. So, trying to just uncomment the test.

What changes are included in this PR?

Test uncommented.

Are these changes tested?

Are there any user-facing changes?

@github-actionsgithub-actionsBot added the sqllogictest SQL Logic Tests (.slt) label Aug 11, 2024
@alambalamb changed the title test: window function over parquet with forced collisionstest: re-enable window function over parquet with forced collisionsAug 12, 2024

@alambalamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @korowa

FYI @nrc who originally reported this was failing

@alamb

Copy link
Copy Markdown
Contributor

I re-ran the relevant test:

cargo test --test sqllogictests --features=force_hash_collisions -- parquet

And indeed it passes locally for me too

andrewlamb@Andrews-MBP-2:~/Software/datafusion$ cargo test --test sqllogictests --features=force_hash_collisions -- parquet
warning: function `hash_map_array` is never used
--> datafusion/common/src/hash_utils.rs:249:4
|
249 | fn hash_map_array(
| ^^^^^^^^^^^^^^
|
= note: `#[warn(dead_code)]` on by default
warning: `datafusion-common` (lib) generated 1 warning
Finished `test` profile [unoptimized + debuginfo] target(s) in 0.40s
Running bin/sqllogictests.rs (target/debug/deps/sqllogictests-a3320b7543efea67)
Running "parquet.slt"
Running "parquet_sorted_statistics.slt"
andrewlamb@Andrews-MBP-2:~/Software/datafusion$


# FIXME(#TODO) fails with feature `force_hash_collisions`
# https://github.com/apache/datafusion/issues/11660
# Perform the query:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# Perform the query:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would be great to add some comments why test is so specific

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree better comments would be nice -- however I don't think this PR makes the comment any more/less cryptic, so I don't think we should hold it for better comments.

Maybe we can improve the comments as a future PR

@alambalamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks agian @korowa and @comphead


# FIXME(#TODO) fails with feature `force_hash_collisions`
# https://github.com/apache/datafusion/issues/11660
# Perform the query:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree better comments would be nice -- however I don't think this PR makes the comment any more/less cryptic, so I don't think we should hold it for better comments.

Maybe we can improve the comments as a future PR

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

sqllogictestSQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Window function test fails when force_hash_collisions is enabled

3 participants

@korowa@alamb@comphead