Uh oh!
There was an error while loading. Please reload this page.
ARROW-16439: [R] Implement binding for lubridate::fast_strptime - #13174
ARROW-16439: [R] Implement binding for lubridate::fast_strptime#13174dragosmg wants to merge 8 commits into
lubridate::fast_strptime#13174Conversation
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
fast_strptimefast_strptimelubridate::fast_strptimeUh oh!
There was an error while loading. Please reload this page.
There is a slight problem though - in the way the b<-"68-10-07 19:04:0"
strptime(b, format="%Y-%m-%d %H:%M:%S")
#> [1] "0068-10-07 19:04:00 LMT"
strptime(b, format="%y-%m-%d %H:%M:%S")
#> [1] "2068-10-07 19:04:00 BST"lubridate::fast_strptime(b, format="%Y-%m-%d %H:%M:%S")
#> [1] NAlubridate::fast_strptime(b, format="%y-%m-%d %H:%M:%S")
#> [1] "2068-10-07 19:04:00 UTC"Created on 2022-05-19 by the reprex package (v2.0.1) This could trip users up (mostly when they pass multiple library(arrow, warn.conflicts=FALSE)
library(lubridate, warn.conflicts=FALSE)
library(dplyr, warn.conflicts=FALSE)
dates_table<- tibble(
string_with_short_year= c("68-05-17", "69-05-17", "55-05-17")
)
dates_table %>% mutate(
date= fast_strptime(
string_with_short_year, format= c("%Y-%m-%d", "%y-%m-%d"),
lt=TRUE
)
)
#> # A tibble: 3 × 2#> string_with_short_year date #> <chr> <dttm> #> 1 68-05-17 2068-05-17 00:00:00#> 2 69-05-17 1969-05-17 00:00:00#> 3 55-05-17 2055-05-17 00:00:00dates_table %>% arrow_table() %>% mutate(
date= fast_strptime(
string_with_short_year, format= c("%Y-%m-%d", "%y-%m-%d"),
lt=FALSE
)
) %>% collect()
#> # A tibble: 3 × 2#> string_with_short_year date #> <chr> <dttm> #> 1 68-05-17 0068-05-17 00:00:00#> 2 69-05-17 0069-05-17 00:00:00#> 3 55-05-17 0055-05-17 00:00:00Created on 2022-05-19 by the reprex package (v2.0.1) What happens here 👆🏻 is that I flagged this as part of ARROW-16596. Not quite sure how to go about handling that only on the R side though. arrow's |
| )#, | ||
| # arrow does not preserve the `tzone` attribute | ||
| # test ignore_attr = TRUE |
There was a problem hiding this comment.
We should remove these commented lines, yeah?
There was a problem hiding this comment.
I yes, sorry. Forgot about those. Do I open a minor PR?
There was a problem hiding this comment.
Or should I just do it in one of the other PR I have going?
There was a problem hiding this comment.
@jonkeane I removed the tests in dragosmg@bde85ce
ursabot
commented
May 20, 2022
Benchmark runs are scheduled for baseline = 8394571 and contender = 7f31c9d. 7f31c9d is a master commit associated with this PR. Results will be available as each benchmark for each run completes. |
…Hub issue numbers (#34260) Rewrite the Jira issue numbers to the GitHub issue numbers, so that the GitHub issue numbers are automatically linked to the issues by pkgdown's auto-linking feature. Issue numbers have been rewritten based on the following correspondence. Also, the pkgdown settings have been changed and updated to link to GitHub. I generated the Changelog page using the `pkgdown::build_news()` function and verified that the links work correctly. --- ARROW-6338#5198ARROW-6364#5201ARROW-6323#5169ARROW-6278#5141ARROW-6360#5329ARROW-6533#5450ARROW-6348#5223ARROW-6337#5399ARROW-10850#9128ARROW-10624#9092ARROW-10386#8549ARROW-6994#23308ARROW-12774#10320ARROW-12670#10287ARROW-16828#13484ARROW-14989#13482ARROW-16977#13514ARROW-13404#10999ARROW-16887#13601ARROW-15906#13206ARROW-15280#13171ARROW-16144#13183ARROW-16511#13105ARROW-16085#13088ARROW-16715#13555ARROW-16268#13550ARROW-16700#13518ARROW-16807#13583ARROW-16871#13517ARROW-16415#13190ARROW-14821#12154ARROW-16439#13174ARROW-16394#13118ARROW-16516#13163ARROW-16395#13627ARROW-14848#12589ARROW-16407#13196ARROW-16653#13506ARROW-14575#13160ARROW-15271#13170ARROW-16703#13650ARROW-16444#13397ARROW-15016#13541ARROW-16776#13563ARROW-15622#13090ARROW-18131#14484ARROW-18305#14581ARROW-18285#14615 * Closes: #33631 Authored-by: SHIMA Tatsuya <ts1s1andn@gmail.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
This PR adds:
fast_strptimefunctionalityThis PR does not support the following arguments:
lt = TRUE- this returns a POSIXlt object (a list) which cannot be easily used in a dplyr pipeline (currently it actually errors) => we have a different defaultlt = FALSEfor the Arrow binding, andcutoff_2000 = 68L- for they%format two-digit numbers smaller or equal tocutoff_2000are parsed as though starting with 20, otherwise parsed as though starting with 19. It would be nice to have this, so I raised ARROW-16596. We can always suggest users they manipulate the strings before parsing, so I don't think this is crucial functionality.The following code will be possible once the PR is merged:
Created on 2022-05-18 by the reprex package (v2.0.1)