Skip to content

ARROW-10099: [C++][Dataset] Simplify type inference for partition columns - #8367

Closed
bkietz wants to merge 7 commits into
apache:masterfrom
bkietz:10099-Also-allow-integer-partit
Closed

ARROW-10099: [C++][Dataset] Simplify type inference for partition columns#8367
bkietz wants to merge 7 commits into
apache:masterfrom
bkietz:10099-Also-allow-integer-partit

Conversation

@bkietz

Copy link
Copy Markdown
Member

Removed cardinality considerations for inferring partition field types. There is now a boolean flag (inspect_dictionary, default false) which if set causes fields to be inferred as a dictionary encoded type instead of the corresponding value type.

@github-actions

Copy link
Copy Markdown

@jorisvandenbosschejorisvandenbossche left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like the simplification!

Comment threadcpp/src/arrow/dataset/partition.h Outdated
Comment threadpython/pyarrow/_dataset.pyx Outdated
Comment threadpython/pyarrow/_dataset.pyx Outdated
Comment threadpython/pyarrow/_dataset.pyx Outdated
Comment threadpython/pyarrow/_dataset.pyx Outdated
bkietzand others added 2 commits October 7, 2020 13:38
Co-authored-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
Co-authored-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@bkietz@jorisvandenbossche