Skip to content

ARROW-10677: [Rust] Fix CSV Boolean parsing + add tests to demonstrate supported csv parsing - #8733

Closed
alamb wants to merge 1 commit into
apache:masterfrom
alamb:alamb/ARROW-10677-boolean-parsing
Closed

ARROW-10677: [Rust] Fix CSV Boolean parsing + add tests to demonstrate supported csv parsing#8733
alamb wants to merge 1 commit into
apache:masterfrom
alamb:alamb/ARROW-10677-boolean-parsing

Conversation

@alamb

@alambalamb commented Nov 21, 2020

Copy link
Copy Markdown
Contributor

Background:
https://github.com/apache/arrow/pull/8714/files# / ARROW-10654 adds some specialized parsing for the csv reader but there was no unit test coverage.

I am fairly sure that a late commit actually introduced a bug, but clearly there weren't unit tests to find it (see details 52bf0e8#r528201732)

Changes:

  1. Fix the bug
  2. Add boolean parsing support as protection against regression and explicit documentation of what boolean types are supported so that if we decide to change these implementations in the future it will be clearer if we are adding/removing support

@github-actions

Copy link
Copy Markdown

@alamb
alambforce-pushed the alamb/ARROW-10677-boolean-parsing branch from 3a3a353 to 3f63f67CompareNovember 21, 2020 23:12
@alamb
alamb marked this pull request as ready for review November 21, 2020 23:12
@Dandandan

Copy link
Copy Markdown
Contributor

👍

@alamb
alambforce-pushed the alamb/ARROW-10677-boolean-parsing branch from 3f63f67 to 0432192CompareNovember 22, 2020 12:24
Comment threadrust/arrow/src/csv/reader.rs Outdated

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note the condition was inverted here ("False" --> Some(true)) -- this was introduced in #8714 by accident

@alambalamb changed the title ARROW-10677: [Rust] Add tests to demonstrate supported csv parsingARROW-10677: [Rust] Fix CSV Boolean parsing + add tests to demonstrate supported csv parsingNov 22, 2020
@alamb
alamb requested a review from nevi-meNovember 22, 2020 12:29
@alamb

Copy link
Copy Markdown
ContributorAuthor

looks like this needs a rebase -- doing so now

@alamb
alambforce-pushed the alamb/ARROW-10677-boolean-parsing branch from 0432192 to 67cd72aCompareNovember 23, 2020 21:44
@alambalamb closed this in 42564e4Nov 23, 2020
@alamb
alamb deleted the alamb/ARROW-10677-boolean-parsing branch December 7, 2020 19:30
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@alamb@Dandandan@vertexclique@paddyhoran