[fix](datetime) fix datetime round on BE by RoanHeNaN · Pull Request #31205 · apache/doris

RoanHeNaN · 2024-02-21T06:48:10Z

with tmp as (
select CONCAT(
YEAR('2024-02-06 03:37:07.157'), '-', LPAD(MONTH('2024-02-06 03:37:07.157'), 2, '0'), '-',
LPAD(DAY('2024-02-06 03:37:07.157'), 2, '0'), '',
LPAD(HOUR('2024-02-06 03:37:07.157'), 2, '0'), ':',
LPAD(MINUTE('2024-02-06 03:37:07.157'), 2, '0'), ':',
LPAD(SECOND('2024-02-06 03:37:07.157'), 2, '0'), '.', "123456789" )
AS generated_string)
select generated_string, cast(generated_string as DateTime(6)) from tmp

before (incorrect round)

+-------------------------------+-----------------------------------------+
| generated_string | cast(generated_string as DATETIMEV2(6)) |
+-------------------------------+-----------------------------------------+
| 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123456 |
+-------------------------------+-----------------------------------------+

after (round up, keep consistent with mysql):

+-------------------------------+-----------------------------------------+
| generated_string | cast(generated_string as DATETIMEV2(6)) |
+-------------------------------+-----------------------------------------+
| 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123457 |
+-------------------------------+-----------------------------------------+
1 row in set (0.03 sec)

same work with #30744 but implemented on BE

doris-robot · 2024-02-21T06:48:15Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

RoanHeNaN · 2024-02-21T06:48:19Z

run buildall

github-actions · 2024-02-21T06:57:32Z

clang-tidy review says "All clean, LGTM! 👍"

zclllyybb

LGTM

github-actions · 2024-02-21T07:09:16Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-02-21T07:09:18Z

PR approved by anyone and no changes requested.

doris-robot · 2024-02-21T07:13:07Z

TPC-H: Total hot run time: 41273 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit afd0540df96301fccc570198fbd103bbdea249f7, data reload: false
------ Round 1 ----------------------------------
q1	17622	4962	4836	4836
q2	2055	138	133	133
q3	10669	1008	988	988
q4	4774	935	952	935
q5	7726	3248	3256	3248
q6	193	132	133	132
q7	1244	772	772	772
q8	9394	2071	2069	2069
q9	7954	6708	6648	6648
q10	8360	2634	2621	2621
q11	432	205	196	196
q12	1109	320	348	320
q13	18052	3634	3642	3634
q14	289	261	254	254
q15	619	501	509	501
q16	521	408	418	408
q17	936	873	833	833
q18	7136	6624	6661	6624
q19	1702	1495	1655	1495
q20	567	337	347	337
q21	6154	3971	3953	3953
q22	388	351	336	336
Total cold run time: 107896 ms
Total hot run time: 41273 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4876	4811	4811	4811
q2	294	182	181	181
q3	3562	3555	3562	3555
q4	2512	2508	2505	2505
q5	5733	5702	5716	5702
q6	206	129	122	122
q7	2228	1638	1632	1632
q8	3006	3071	3094	3071
q9	8629	8695	8667	8667
q10	4130	4198	4217	4198
q11	507	380	352	352
q12	757	554	533	533
q13	4178	3371	3387	3371
q14	264	224	242	224
q15	580	510	501	501
q16	491	432	441	432
q17	1669	1574	1590	1574
q18	8359	7704	7722	7704
q19	1629	1633	1629	1629
q20	2132	1820	1825	1820
q21	6505	6092	6064	6064
q22	558	492	491	491
Total cold run time: 62805 ms
Total hot run time: 59139 ms

doris-robot · 2024-02-21T07:15:42Z

TeamCity be ut coverage result:
Function Coverage: 35.72% (8558/23959)
Line Coverage: 27.60% (69414/251541)
Region Coverage: 26.73% (36016/134746)
Branch Coverage: 23.55% (18422/78238)
Coverage Report: http://coverage.selectdb-in.cc/coverage/afd0540df96301fccc570198fbd103bbdea249f7_afd0540df96301fccc570198fbd103bbdea249f7/report/index.html

with tmp as ( select CONCAT( YEAR('2024-02-06 03:37:07.157'), '-', LPAD(MONTH('2024-02-06 03:37:07.157'), 2, '0'), '-', LPAD(DAY('2024-02-06 03:37:07.157'), 2, '0'), ' ', LPAD(HOUR('2024-02-06 03:37:07.157'), 2, '0'), ':', LPAD(MINUTE('2024-02-06 03:37:07.157'), 2, '0'), ':', LPAD(SECOND('2024-02-06 03:37:07.157'), 2, '0'), '.', "123456789" ) AS generated_string) select generated_string, cast(generated_string as DateTime(6)) from tmp before (incorrect round) +-------------------------------+-----------------------------------------+ | generated_string | cast(generated_string as DATETIMEV2(6)) | +-------------------------------+-----------------------------------------+ | 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123456 | +-------------------------------+-----------------------------------------+ after (round up, keep consistent with mysql): +-------------------------------+-----------------------------------------+ | generated_string | cast(generated_string as DATETIMEV2(6)) | +-------------------------------+-----------------------------------------+ | 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123457 | +-------------------------------+-----------------------------------------+ 1 row in set (0.03 sec) same work with apache#30744 but implemented on BE

with tmp as ( select CONCAT( YEAR('2024-02-06 03:37:07.157'), '-', LPAD(MONTH('2024-02-06 03:37:07.157'), 2, '0'), '-', LPAD(DAY('2024-02-06 03:37:07.157'), 2, '0'), ' ', LPAD(HOUR('2024-02-06 03:37:07.157'), 2, '0'), ':', LPAD(MINUTE('2024-02-06 03:37:07.157'), 2, '0'), ':', LPAD(SECOND('2024-02-06 03:37:07.157'), 2, '0'), '.', "123456789" ) AS generated_string) select generated_string, cast(generated_string as DateTime(6)) from tmp before (incorrect round) +-------------------------------+-----------------------------------------+ | generated_string | cast(generated_string as DATETIMEV2(6)) | +-------------------------------+-----------------------------------------+ | 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123456 | +-------------------------------+-----------------------------------------+ after (round up, keep consistent with mysql): +-------------------------------+-----------------------------------------+ | generated_string | cast(generated_string as DATETIMEV2(6)) | +-------------------------------+-----------------------------------------+ | 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123457 | +-------------------------------+-----------------------------------------+ 1 row in set (0.03 sec) same work with #30744 but implemented on BE

with tmp as ( select CONCAT( YEAR('2024-02-06 03:37:07.157'), '-', LPAD(MONTH('2024-02-06 03:37:07.157'), 2, '0'), '-', LPAD(DAY('2024-02-06 03:37:07.157'), 2, '0'), ' ', LPAD(HOUR('2024-02-06 03:37:07.157'), 2, '0'), ':', LPAD(MINUTE('2024-02-06 03:37:07.157'), 2, '0'), ':', LPAD(SECOND('2024-02-06 03:37:07.157'), 2, '0'), '.', "123456789" ) AS generated_string) select generated_string, cast(generated_string as DateTime(6)) from tmp before (incorrect round) +-------------------------------+-----------------------------------------+ | generated_string | cast(generated_string as DATETIMEV2(6)) | +-------------------------------+-----------------------------------------+ | 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123456 | +-------------------------------+-----------------------------------------+ after (round up, keep consistent with mysql): +-------------------------------+-----------------------------------------+ | generated_string | cast(generated_string as DATETIMEV2(6)) | +-------------------------------+-----------------------------------------+ | 2024-02-06 03:37:07.123456789 | 2024-02-06 03:37:07.123457 | +-------------------------------+-----------------------------------------+ 1 row in set (0.03 sec) same work with apache#30744 but implemented on BE

RoanHeNaN added 3 commits February 21, 2024 14:33

FINISH
1d74a42

BETTER
c0783ae

FIX
afd0540

RoanHeNaN mentioned this pull request Feb 21, 2024
[opt](datetime) truncate the digits that fall outside the precision range #31196
Closed

yiguolei added the dev/2.0.5 label Feb 21, 2024

yiguolei approved these changes Feb 21, 2024
View reviewed changes

zclllyybb approved these changes Feb 21, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Feb 21, 2024

github-actionsBot added the reviewed label Feb 21, 2024

yiguolei merged commit 989c634 into apache:masterFeb 21, 2024

yiguolei added the usercase Important user case type label label Feb 21, 2024

RoanHeNaN deleted the opt-datetime-round-be branch February 21, 2024 09:48

RoanHeNaN mentioned this pull request Feb 21, 2024
[fix](datetime) fix datetime round on BE (#31205) #31229
Merged

yiguolei added dev/2.0.5-merged and removed dev/2.0.5 labels Feb 21, 2024

RoanHeNaN mentioned this pull request Mar 13, 2024
[fix](datetime) fix datetime rounding on BE #32075
Merged

Navigation Menu

Uh oh!

[fix](datetime) fix datetime round on BE - #31205

[fix](datetime) fix datetime round on BE#31205
yiguolei merged 3 commits into
apache:masterfrom
RoanHeNaN:opt-datetime-round-be

RoanHeNaN commented Feb 21, 2024

Uh oh!

doris-robot commented Feb 21, 2024

Uh oh!

RoanHeNaN commented Feb 21, 2024

Uh oh!

github-actionsBot commented Feb 21, 2024

Uh oh!

zclllyybb left a comment

Uh oh!

github-actionsBot commented Feb 21, 2024

Uh oh!

github-actionsBot commented Feb 21, 2024

Uh oh!

doris-robot commented Feb 21, 2024

Uh oh!

doris-robot commented Feb 21, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

RoanHeNaN commented Feb 21, 2024

Uh oh!

doris-robot commented Feb 21, 2024

Uh oh!

RoanHeNaN commented Feb 21, 2024

Uh oh!

github-actionsBot commented Feb 21, 2024

Uh oh!

zclllyybb left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Feb 21, 2024

Uh oh!

github-actionsBot commented Feb 21, 2024

Uh oh!

doris-robot commented Feb 21, 2024

Uh oh!

doris-robot commented Feb 21, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants