[FIX](serde)fix datetimev2 serde parse from string with scale by amorynan · Pull Request #27965 · apache/doris

amorynan · 2023-12-04T12:13:56Z

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

github-actions · 2023-12-04T12:20:42Z

clang-tidy review says "All clean, LGTM! 👍"

github-actions · 2023-12-04T12:41:56Z

clang-tidy review says "All clean, LGTM! 👍"

amorynan · 2023-12-04T12:55:02Z

run buildall

dataroaring

LGTM

github-actions · 2023-12-04T13:55:15Z

PR approved by at least one committer and no changes requested.

github-actions · 2023-12-04T13:55:17Z

PR approved by anyone and no changes requested.

doris-robot · 2023-12-04T15:32:45Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 44.32 seconds
stream load tsv: 574 seconds loaded 74807831229 Bytes, about 124 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.9 seconds inserted 10000000 Rows, about 346K ops/s
storage size: 17164142029 Bytes

amorynan · 2023-12-05T02:59:39Z

run buildall

github-actions · 2023-12-05T03:06:51Z

clang-tidy review says "All clean, LGTM! 👍"

zclllyybb

LGTM

dataroaring

LGTM

github-actions · 2023-12-05T04:20:06Z

PR approved by at least one committer and no changes requested.

doris-robot · 2023-12-05T05:37:22Z

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 43.67 seconds
stream load tsv: 565 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 18 seconds loaded 2358488459 Bytes, about 124 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.4 seconds inserted 10000000 Rows, about 352K ops/s
storage size: 17164126787 Bytes

doris-robot · 2023-12-05T06:01:11Z

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Tpch sf100 test result on commit 28dc7c8adb95a1975b88126c8faf67daa34058fc, data reload: false
run tpch-sf100 query with default conf and session variables
q1	4907	4700	4700	4700
q2	374	147	160	147
q3	1505	1306	1290	1290
q4	1146	972	970	970
q5	3273	3240	3227	3227
q6	258	128	128	128
q7	1042	499	513	499
q8	2258	2239	2242	2239
q9	6877	6879	6886	6879
q10	3254	3352	3322	3322
q11	341	206	215	206
q12	362	209	214	209
q13	4653	3887	3814	3814
q14	243	212	224	212
q15	609	539	551	539
q16	452	396	402	396
q17	1034	645	579	579
q18	7799	7374	7388	7374
q19	1567	1551	1543	1543
q20	548	347	338	338
q21	3421	2934	2984	2934
q22	380	306	311	306
Total cold run time: 46303 ms
Total hot run time: 41851 ms
run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4628	4640	4583	4583
q2	312	199	223	199
q3	3743	3724	3722	3722
q4	2551	2530	2538	2530
q5	6120	6127	6143	6127
q6	243	122	123	122
q7	2551	1948	1919	1919
q8	3745	3756	3723	3723
q9	9398	9327	9289	9289
q10	4031	4125	4122	4122
q11	594	488	475	475
q12	816	629	641	629
q13	4385	3633	3646	3633
q14	282	256	253	253
q15	585	533	534	533
q16	542	483	472	472
q17	2019	1950	1987	1950
q18	9249	8746	9026	8746
q19	1744	1754	1753	1753
q20	2311	1978	1962	1962
q21	7152	6792	6760	6760
q22	694	562	591	562
Total cold run time: 67695 ms
Total hot run time: 64064 ms

…#27965)

RoanHeNaN · 2024-03-19T03:54:08Z

This pr should be merge to branch-2.0

…#27965)

fix datetimev2 serde parse from string with scale
5b400cb

revert normal
f0604c3

dataroaring previously approved these changes Dec 4, 2023
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Dec 4, 2023

github-actionsBot added the reviewed label Dec 4, 2023

fix out add csv
28dc7c8

amorynan dismissed dataroaring’s stale review via 28dc7c8December 5, 2023 02:59

github-actionsBot removed the approved Indicates a PR has been approved by one committer. label Dec 5, 2023

zclllyybb approved these changes Dec 5, 2023
View reviewed changes

dataroaring approved these changes Dec 5, 2023
View reviewed changes

dataroaring added the dev/2.0.4 label Dec 5, 2023

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Dec 5, 2023

dataroaring merged commit 79f6f85 into apache:masterDec 5, 2023

XuJianxu pushed a commit to XuJianxu/doris that referenced this pull request Dec 14, 2023
[FIX](serde)fix datetimev2 serde parse from string with scale (apache…
1582eb4
…#27965)

RoanHeNaN mentioned this pull request Mar 19, 2024
[fix](datetime) fix datetime rounding on BE (#32075) #32359
Merged

RoanHeNaN pushed a commit to RoanHeNaN/doris that referenced this pull request Mar 19, 2024
[FIX](serde)fix datetimev2 serde parse from string with scale (apache…
04935bb
…#27965)

RoanHeNaN mentioned this pull request Mar 19, 2024
[FIX](serde)fix datetimev2 serde parse from string with scale (#27965) #32480
Closed

xiaokang removed the dev/2.0.4 label Mar 19, 2024

xiaokang added p0_b dev/2.0.x labels Mar 19, 2024

amorynan mentioned this pull request Mar 20, 2024
[FIX](serde )pick 27965 for decimalv2 #32533
Merged

yiguolei added dev/2.0.7-merged and removed dev/2.0.x labels Mar 21, 2024

xiaokang added the kind/behavior-changed label Mar 22, 2024

xiaokang mentioned this pull request Mar 22, 2024
Release Note 2.0.7 #32677
Closed

Uh oh!

Conversation

amorynan commented Dec 4, 2023

Proposed changes

Further comments

Uh oh!

github-actionsBot commented Dec 4, 2023

Uh oh!

github-actionsBot commented Dec 4, 2023

Uh oh!

amorynan commented Dec 4, 2023

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Dec 4, 2023

Uh oh!

github-actionsBot commented Dec 4, 2023

Uh oh!

doris-robot commented Dec 4, 2023

Uh oh!

amorynan commented Dec 5, 2023

Uh oh!

github-actionsBot commented Dec 5, 2023

Uh oh!

zclllyybb left a comment

Choose a reason for hiding this comment

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Dec 5, 2023

Uh oh!

doris-robot commented Dec 5, 2023

Uh oh!

doris-robot commented Dec 5, 2023

Uh oh!

RoanHeNaN commented Mar 19, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants