[enhancement](log) Changed log of waiting previous transactions to info level for debug convenience by Hastyshell · Pull Request #38133 · apache/doris

Hastyshell · 2024-07-19T07:56:26Z

Proposed changes

As title.

doris-robot · 2024-07-19T07:56:31Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

Hastyshell · 2024-07-19T07:56:36Z

run buildall

Hastyshell · 2024-07-19T08:26:48Z

run performance

doris-robot · 2024-07-19T10:32:36Z

TPC-H: Total hot run time: 39731 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8fd411673f65d5537f56c9a5e5bc8bc27bd982b0, data reload: false
------ Round 1 ----------------------------------
q1	17629	4306	4222	4222
q2	2014	192	201	192
q3	10451	1143	1060	1060
q4	10181	856	829	829
q5	7553	2703	2674	2674
q6	218	134	134	134
q7	952	586	590	586
q8	9228	2080	2053	2053
q9	8614	6544	6485	6485
q10	8856	3810	3718	3718
q11	461	233	238	233
q12	399	222	221	221
q13	17773	3102	3136	3102
q14	283	243	249	243
q15	542	494	482	482
q16	487	381	380	380
q17	983	659	696	659
q18	8162	7329	7485	7329
q19	7294	1458	1351	1351
q20	673	317	315	315
q21	4806	3219	3185	3185
q22	342	280	278	278
Total cold run time: 117901 ms
Total hot run time: 39731 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4329	4201	4233	4201
q2	386	270	267	267
q3	2973	2873	2890	2873
q4	2024	1679	1721	1679
q5	5601	5578	5523	5523
q6	217	139	136	136
q7	2174	1916	1868	1868
q8	3254	3430	3716	3430
q9	8707	8834	8814	8814
q10	4135	3809	3790	3790
q11	591	494	495	494
q12	812	642	643	642
q13	15854	3192	3148	3148
q14	306	282	297	282
q15	525	490	492	490
q16	498	430	445	430
q17	1814	1523	1516	1516
q18	8032	7952	7796	7796
q19	1768	1717	1511	1511
q20	2134	1901	1875	1875
q21	9722	4792	4803	4792
q22	624	501	507	501
Total cold run time: 76480 ms
Total hot run time: 56058 ms

doris-robot · 2024-07-19T10:43:43Z

TPC-DS: Total hot run time: 173053 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8fd411673f65d5537f56c9a5e5bc8bc27bd982b0, data reload: false
query1	917	376	359	359
query2	6410	1848	1897	1848
query3	6659	208	213	208
query4	25783	17468	17428	17428
query5	3664	467	495	467
query6	253	163	182	163
query7	4591	289	277	277
query8	247	194	187	187
query9	8834	2474	2452	2452
query10	444	300	270	270
query11	11536	10035	10126	10035
query12	118	85	99	85
query13	1649	366	364	364
query14	10202	7384	7180	7180
query15	226	169	167	167
query16	7700	485	504	485
query17	1541	573	546	546
query18	1952	289	297	289
query19	201	156	159	156
query20	92	83	82	82
query21	208	130	122	122
query22	4411	4134	3978	3978
query23	33961	33625	33665	33625
query24	10996	2961	2854	2854
query25	618	399	378	378
query26	701	151	148	148
query27	2269	278	284	278
query28	6294	2076	2056	2056
query29	892	638	624	624
query30	251	153	147	147
query31	961	785	763	763
query32	94	52	57	52
query33	672	339	333	333
query34	906	493	515	493
query35	893	759	744	744
query36	1137	963	964	963
query37	139	82	78	78
query38	2920	2826	2805	2805
query39	848	805	810	805
query40	200	115	116	115
query41	41	43	44	43
query42	117	101	98	98
query43	515	470	463	463
query44	1067	744	722	722
query45	192	159	161	159
query46	1075	730	717	717
query47	1864	1760	1771	1760
query48	352	296	308	296
query49	826	396	403	396
query50	787	390	386	386
query51	6871	6845	6748	6748
query52	106	88	91	88
query53	353	287	283	283
query54	869	445	437	437
query55	75	72	73	72
query56	280	254	269	254
query57	1164	1043	1037	1037
query58	233	240	241	240
query59	2810	2492	2790	2492
query60	306	270	277	270
query61	92	92	121	92
query62	786	651	661	651
query63	322	289	284	284
query64	9119	2205	1656	1656
query65	3178	3082	3108	3082
query66	741	328	328	328
query67	15385	14957	14985	14957
query68	4571	540	539	539
query69	639	453	347	347
query70	1169	1163	1140	1140
query71	401	278	277	277
query72	7285	5274	5571	5274
query73	759	327	321	321
query74	6219	5653	5703	5653
query75	3416	2678	2687	2678
query76	2648	946	881	881
query77	635	307	296	296
query78	11400	9116	9085	9085
query79	2993	526	516	516
query80	1938	461	465	461
query81	578	218	223	218
query82	746	137	139	137
query83	326	171	165	165
query84	273	92	96	92
query85	1487	305	356	305
query86	456	317	295	295
query87	3302	3055	3083	3055
query88	3999	2340	2362	2340
query89	499	375	377	375
query90	1758	184	183	183
query91	129	96	101	96
query92	58	49	48	48
query93	4726	520	521	520
query94	793	296	291	291
query95	405	313	312	312
query96	604	268	267	267
query97	3244	3048	3010	3010
query98	221	212	194	194
query99	1622	1265	1262	1262
Total cold run time: 281215 ms
Total hot run time: 173053 ms

doris-robot · 2024-07-19T10:49:15Z

ClickBench: Total hot run time: 30.09 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8fd411673f65d5537f56c9a5e5bc8bc27bd982b0, data reload: false
query1	0.04	0.03	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.69	0.07	0.08
query5	0.49	0.50	0.47
query6	1.13	0.72	0.73
query7	0.02	0.02	0.01
query8	0.05	0.04	0.05
query9	0.55	0.49	0.48
query10	0.54	0.54	0.54
query11	0.16	0.11	0.12
query12	0.14	0.12	0.13
query13	0.58	0.60	0.58
query14	0.76	0.77	0.76
query15	0.86	0.82	0.81
query16	0.35	0.36	0.36
query17	1.02	1.03	1.03
query18	0.22	0.21	0.22
query19	1.79	1.81	1.72
query20	0.02	0.01	0.01
query21	15.41	0.77	0.67
query22	4.77	7.78	1.27
query23	18.23	1.40	1.28
query24	2.07	0.25	0.22
query25	0.16	0.10	0.08
query26	0.29	0.21	0.21
query27	0.46	0.23	0.23
query28	13.27	1.01	0.99
query29	12.65	3.37	3.36
query30	0.24	0.06	0.05
query31	2.86	0.39	0.38
query32	3.29	0.48	0.47
query33	2.87	2.92	2.93
query34	16.82	4.39	4.34
query35	4.40	4.44	4.48
query36	0.65	0.48	0.46
query37	0.19	0.16	0.16
query38	0.15	0.14	0.15
query39	0.04	0.04	0.03
query40	0.15	0.12	0.12
query41	0.09	0.04	0.05
query42	0.05	0.04	0.05
query43	0.05	0.03	0.04
Total cold run time: 109.87 s
Total hot run time: 30.09 s

Hastyshell · 2024-07-20T03:37:52Z

run p0

…nfo level for debug convenience

Hastyshell · 2024-07-22T03:29:39Z

run buildall

doris-robot · 2024-07-22T04:00:38Z

TPC-H: Total hot run time: 40374 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5f77784af16d7917dc5988312efc672f90282cd2, data reload: false
------ Round 1 ----------------------------------
q1	18748	5618	4394	4394
q2	2669	194	200	194
q3	11497	1185	1220	1185
q4	10606	831	885	831
q5	7852	2757	2739	2739
q6	225	141	146	141
q7	992	630	644	630
q8	9605	2152	2092	2092
q9	8928	6618	6605	6605
q10	8630	3745	3837	3745
q11	456	244	248	244
q12	398	228	230	228
q13	17789	3011	2973	2973
q14	269	235	234	234
q15	530	476	495	476
q16	496	378	394	378
q17	985	646	655	646
q18	8050	7591	7364	7364
q19	8376	1472	1387	1387
q20	678	326	326	326
q21	4914	3270	3289	3270
q22	348	295	292	292
Total cold run time: 123041 ms
Total hot run time: 40374 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4403	4265	4245	4245
q2	360	271	261	261
q3	3044	2798	2766	2766
q4	1879	1631	1685	1631
q5	5324	5349	5328	5328
q6	221	136	136	136
q7	2127	1679	1760	1679
q8	3224	3377	3348	3348
q9	8439	8385	8415	8385
q10	3893	3696	3751	3696
q11	573	510	492	492
q12	803	591	615	591
q13	16276	2988	3044	2988
q14	297	271	268	268
q15	518	464	486	464
q16	473	409	446	409
q17	1818	1507	1493	1493
q18	7607	7637	7340	7340
q19	1680	1591	1634	1591
q20	1982	1804	1815	1804
q21	4896	4749	4669	4669
q22	590	499	507	499
Total cold run time: 70427 ms
Total hot run time: 54083 ms

doris-robot · 2024-07-22T04:12:07Z

TPC-DS: Total hot run time: 173754 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5f77784af16d7917dc5988312efc672f90282cd2, data reload: false
query1	925	372	366	366
query2	6446	1892	1831	1831
query3	6670	214	219	214
query4	23830	17448	17333	17333
query5	4192	486	489	486
query6	270	177	163	163
query7	4589	288	300	288
query8	235	203	201	201
query9	8590	2483	2460	2460
query10	435	296	271	271
query11	10749	10024	10051	10024
query12	135	84	88	84
query13	1652	376	376	376
query14	10295	7715	7967	7715
query15	230	173	176	173
query16	7702	475	455	455
query17	1532	561	560	560
query18	1857	294	290	290
query19	203	155	165	155
query20	94	85	86	85
query21	217	131	128	128
query22	4239	4066	4006	4006
query23	34012	32924	33192	32924
query24	12157	2894	2947	2894
query25	670	396	400	396
query26	1822	152	160	152
query27	2933	275	277	275
query28	7356	2050	2028	2028
query29	1139	661	654	654
query30	301	151	152	151
query31	941	772	757	757
query32	100	55	58	55
query33	793	353	356	353
query34	905	502	495	495
query35	879	743	727	727
query36	1103	937	940	937
query37	271	86	85	85
query38	2834	2747	2764	2747
query39	885	804	825	804
query40	290	125	126	125
query41	49	53	48	48
query42	121	102	112	102
query43	500	469	470	469
query44	1258	746	746	746
query45	193	168	258	168
query46	1099	743	710	710
query47	1826	1770	1774	1770
query48	372	297	295	295
query49	1195	434	428	428
query50	799	402	400	400
query51	6890	6611	6678	6611
query52	102	102	96	96
query53	362	294	298	294
query54	1044	460	445	445
query55	78	74	76	74
query56	288	297	281	281
query57	1143	1070	1076	1070
query58	263	249	270	249
query59	2845	2568	2743	2568
query60	317	287	310	287
query61	99	93	95	93
query62	812	648	661	648
query63	334	301	300	300
query64	10532	2253	1676	1676
query65	3237	3158	3144	3144
query66	1369	338	342	338
query67	15677	14909	14966	14909
query68	8499	552	576	552
query69	699	461	375	375
query70	1184	1166	1081	1081
query71	507	292	281	281
query72	8434	5861	5737	5737
query73	1397	334	329	329
query74	6203	5641	5672	5641
query75	4354	2752	2737	2737
query76	4968	1039	947	947
query77	693	329	328	328
query78	9758	9027	8974	8974
query79	8423	533	530	530
query80	1488	498	502	498
query81	584	227	237	227
query82	760	139	140	139
query83	228	173	170	170
query84	283	86	88	86
query85	1391	325	291	291
query86	406	323	301	301
query87	3408	3112	3175	3112
query88	4629	2367	2379	2367
query89	523	385	386	385
query90	1997	200	195	195
query91	138	105	104	104
query92	68	52	50	50
query93	5982	522	511	511
query94	1216	295	303	295
query95	411	321	320	320
query96	613	271	268	268
query97	3211	3070	3039	3039
query98	233	201	194	194
query99	1588	1276	1248	1248
Total cold run time: 301558 ms
Total hot run time: 173754 ms

doris-robot · 2024-07-22T04:17:39Z

ClickBench: Total hot run time: 30.88 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5f77784af16d7917dc5988312efc672f90282cd2, data reload: false
query1	0.05	0.04	0.03
query2	0.08	0.05	0.05
query3	0.23	0.05	0.06
query4	1.67	0.09	0.09
query5	0.49	0.48	0.48
query6	1.12	0.72	0.72
query7	0.03	0.02	0.01
query8	0.05	0.05	0.04
query9	0.54	0.48	0.49
query10	0.56	0.55	0.52
query11	0.15	0.11	0.12
query12	0.15	0.12	0.12
query13	0.61	0.60	0.58
query14	0.77	0.80	0.78
query15	0.87	0.82	0.82
query16	0.36	0.36	0.35
query17	1.06	1.01	0.96
query18	0.23	0.22	0.22
query19	1.78	1.72	1.68
query20	0.01	0.01	0.01
query21	15.43	0.76	0.66
query22	4.68	6.93	2.07
query23	18.32	1.33	1.23
query24	2.10	0.23	0.22
query25	0.16	0.09	0.08
query26	0.32	0.21	0.21
query27	0.45	0.23	0.23
query28	13.28	1.02	1.00
query29	12.66	3.42	3.44
query30	0.25	0.06	0.05
query31	2.89	0.39	0.39
query32	3.25	0.49	0.48
query33	2.96	2.97	2.98
query34	16.86	4.39	4.32
query35	4.44	4.40	4.44
query36	0.67	0.46	0.48
query37	0.19	0.16	0.16
query38	0.15	0.14	0.15
query39	0.05	0.04	0.04
query40	0.16	0.13	0.12
query41	0.09	0.05	0.05
query42	0.05	0.04	0.04
query43	0.04	0.05	0.04
Total cold run time: 110.26 s
Total hot run time: 30.88 s

dataroaring

LGTM

github-actions · 2024-07-22T09:21:54Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-07-22T09:21:56Z

PR approved by anyone and no changes requested.

…fo level for debug convenience (apache#38133) As title.

…fo level for debug convenience (#38133) (#38230) ## Proposed changes As title.

…fo level for debug convenience (#38133) As title.

…fo level for debug convenience (apache#38133) As title.

[enhancement](log) Changing log of waiting previous transactions to i…
5f77784
…nfo level for debug convenience

Hastyshell force-pushed the transaction-wait-info-log branch from 8fd4116 to 5f77784Compare July 22, 2024 03:29

dataroaring approved these changes Jul 22, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Jul 22, 2024

github-actionsBot added the reviewed label Jul 22, 2024

Hastyshell changed the title ~~[enhancement](log) Changing log of waiting previous transactions to info level for debug convenience~~[enhancement](log) Changed log of waiting previous transactions to info level for debug convenienceJul 22, 2024

luwei16 approved these changes Jul 22, 2024
View reviewed changes

dataroaring added the dev/2.1.x label Jul 22, 2024

dataroaring merged commit 4589bb1 into apache:masterJul 22, 2024

Hastyshell added a commit to Hastyshell/doris that referenced this pull request Jul 23, 2024
[enhancement](log) Changed log of waiting previous transactions to in…
e1285e3
…fo level for debug convenience (apache#38133) As title.

dataroaring pushed a commit that referenced this pull request Jul 23, 2024
[enhancement](log) Changed log of waiting previous transactions to in…
ba5d23a
…fo level for debug convenience (#38133) (#38230) ## Proposed changes As title.

dataroaring mentioned this pull request Jul 23, 2024
[enhancement](log) Changed log of waiting previous transactions to info level for debug convenience (#38133) #38230
Merged

dataroaring added dev/2.1.6-merged and removed dev/2.1.x labels Jul 23, 2024

dataroaring pushed a commit that referenced this pull request Jul 24, 2024
[enhancement](log) Changed log of waiting previous transactions to in…
470374c
…fo level for debug convenience (#38133) As title.

dataroaring added dev/3.0.1-merged and removed dev/2.1.6-merged labels Jul 31, 2024

dataroaring added the dev/2.1.6-merged label Jul 31, 2024

HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
[enhancement](log) Changed log of waiting previous transactions to in…
fdb28ad
…fo level for debug convenience (apache#38133) As title.

Uh oh!

Conversation

Hastyshell commented Jul 19, 2024

Proposed changes

Uh oh!

doris-robot commented Jul 19, 2024

Uh oh!

Hastyshell commented Jul 19, 2024

Uh oh!

Hastyshell commented Jul 19, 2024

Uh oh!

doris-robot commented Jul 19, 2024

Uh oh!

doris-robot commented Jul 19, 2024

Uh oh!

doris-robot commented Jul 19, 2024

Uh oh!

Hastyshell commented Jul 20, 2024

Uh oh!

Hastyshell commented Jul 22, 2024

Uh oh!

doris-robot commented Jul 22, 2024

Uh oh!

doris-robot commented Jul 22, 2024

Uh oh!

doris-robot commented Jul 22, 2024

Uh oh!

dataroaring left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Jul 22, 2024

Uh oh!

github-actionsBot commented Jul 22, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants