[opt](profile) add index page profile for io by airborne12 · Pull Request #45675 · apache/doris

airborne12 · 2024-12-19T14:08:22Z

What problem does this PR solve?

Related PR: #42697

Problem Summary:

Add zonemap/primary key/bloom filter index page stats into profile

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2024-12-19T14:08:28Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

airborne12 · 2024-12-19T14:08:57Z

run buildall

github-actions · 2024-12-19T14:13:54Z

clang-tidy review says "All clean, LGTM! 👍"

eldenmoon

LGTM

github-actions · 2024-12-19T14:26:15Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-12-19T14:26:18Z

PR approved by anyone and no changes requested.

airborne12 · 2024-12-19T15:06:49Z

run buildall

github-actions · 2024-12-19T15:11:29Z

clang-tidy review says "All clean, LGTM! 👍"

airborne12 · 2024-12-19T15:53:07Z

run buildall

github-actions · 2024-12-19T15:58:17Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-12-19T16:12:05Z

TPC-H: Total hot run time: 39853 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 79eaad814535f780403be701cb05e1a52c922f2a, data reload: false
------ Round 1 ----------------------------------
q1	17592	7350	7304	7304
q2	2052	174	166	166
q3	10686	1086	1201	1086
q4	10561	760	712	712
q5	7597	2706	2695	2695
q6	236	150	147	147
q7	966	627	620	620
q8	9243	1877	1892	1877
q9	6619	6394	6448	6394
q10	6985	2310	2331	2310
q11	467	262	262	262
q12	440	227	220	220
q13	17761	2907	2948	2907
q14	254	213	208	208
q15	560	495	499	495
q16	671	589	579	579
q17	1001	509	606	509
q18	7490	6648	6829	6648
q19	1344	1044	1023	1023
q20	470	194	185	185
q21	3989	3211	3202	3202
q22	368	317	304	304
Total cold run time: 107352 ms
Total hot run time: 39853 ms
----- Round 2, with runtime_filter_mode=off -----
q1	7203	7205	7169	7169
q2	327	231	228	228
q3	2926	2749	2964	2749
q4	2147	1887	1854	1854
q5	5694	5672	5623	5623
q6	222	144	143	143
q7	2216	1818	1794	1794
q8	3373	3497	3508	3497
q9	8914	8975	8937	8937
q10	3611	3510	3563	3510
q11	598	505	499	499
q12	854	605	611	605
q13	12329	3135	3128	3128
q14	309	284	274	274
q15	560	505	493	493
q16	702	659	661	659
q17	1824	1617	1609	1609
q18	8489	7734	7526	7526
q19	1717	1519	1500	1500
q20	2124	1852	1857	1852
q21	5607	5453	5468	5453
q22	661	567	550	550
Total cold run time: 72407 ms
Total hot run time: 59652 ms

doris-robot · 2024-12-19T16:22:22Z

TeamCity be ut coverage result:
Function Coverage: 38.87% (10130/26061)
Line Coverage: 29.80% (85213/285944)
Region Coverage: 28.90% (43462/150365)
Branch Coverage: 25.44% (22163/87124)
Coverage Report: http://coverage.selectdb-in.cc/coverage/79eaad814535f780403be701cb05e1a52c922f2a_79eaad814535f780403be701cb05e1a52c922f2a/report/index.html

doris-robot · 2024-12-19T16:24:20Z

TPC-DS: Total hot run time: 196550 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 79eaad814535f780403be701cb05e1a52c922f2a, data reload: false
query1	1307	963	912	912
query2	6230	2310	2326	2310
query3	11160	4765	4920	4765
query4	32590	23429	23355	23355
query5	3605	484	461	461
query6	297	198	169	169
query7	3998	312	319	312
query8	298	240	240	240
query9	9629	2732	2723	2723
query10	477	249	250	249
query11	17611	15154	15139	15139
query12	150	102	101	101
query13	1559	423	414	414
query14	9926	6683	6897	6683
query15	266	209	203	203
query16	8181	471	458	458
query17	1633	586	566	566
query18	2129	313	322	313
query19	361	158	157	157
query20	140	111	116	111
query21	208	108	112	108
query22	4826	4709	4573	4573
query23	34488	33729	33854	33729
query24	10611	2559	2518	2518
query25	611	383	387	383
query26	1213	165	151	151
query27	2390	328	333	328
query28	7719	2486	2498	2486
query29	839	422	421	421
query30	239	147	146	146
query31	1069	857	854	854
query32	99	57	54	54
query33	767	315	300	300
query34	945	530	522	522
query35	891	786	775	775
query36	1103	963	971	963
query37	144	82	78	78
query38	4491	4278	4316	4278
query39	1501	1526	1469	1469
query40	215	111	110	110
query41	49	50	45	45
query42	122	105	107	105
query43	553	513	499	499
query44	1304	838	806	806
query45	189	172	173	172
query46	1200	699	773	699
query47	2014	1953	1896	1896
query48	424	333	324	324
query49	896	397	401	397
query50	821	390	410	390
query51	7188	7270	7207	7207
query52	105	89	96	89
query53	273	192	186	186
query54	1153	423	465	423
query55	81	77	79	77
query56	260	249	237	237
query57	1322	1187	1138	1138
query58	247	245	231	231
query59	3244	3144	3253	3144
query60	287	246	242	242
query61	108	101	105	101
query62	910	676	686	676
query63	210	191	187	187
query64	3976	675	627	627
query65	3248	3179	3195	3179
query66	824	297	307	297
query67	15881	15615	15510	15510
query68	4956	556	546	546
query69	450	261	252	252
query70	1209	1148	1152	1148
query71	405	262	262	262
query72	6890	4107	4211	4107
query73	778	360	375	360
query74	10579	8921	8794	8794
query75	3398	2618	2646	2618
query76	2738	1239	1039	1039
query77	463	274	268	268
query78	10234	9458	9970	9458
query79	2443	603	616	603
query80	996	496	427	427
query81	550	253	230	230
query82	629	119	128	119
query83	238	143	141	141
query84	230	68	70	68
query85	1708	296	325	296
query86	496	309	300	300
query87	4539	4438	4411	4411
query88	3914	2231	2233	2231
query89	425	296	285	285
query90	2042	190	186	186
query91	144	101	106	101
query92	59	53	51	51
query93	1543	536	541	536
query94	900	285	290	285
query95	347	290	249	249
query96	605	289	285	285
query97	2788	2666	2624	2624
query98	228	206	195	195
query99	1580	1331	1304	1304
Total cold run time: 301309 ms
Total hot run time: 196550 ms

doris-robot · 2024-12-19T16:29:51Z

ClickBench: Total hot run time: 32.35 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 79eaad814535f780403be701cb05e1a52c922f2a, data reload: false
query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.62	0.10	0.10
query5	0.42	0.41	0.39
query6	1.15	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.56	0.52	0.52
query10	0.56	0.59	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.85	2.83	2.87
query15	0.90	0.83	0.82
query16	0.36	0.39	0.37
query17	1.01	1.02	1.02
query18	0.23	0.21	0.21
query19	2.01	1.90	2.01
query20	0.01	0.01	0.02
query21	15.36	0.58	0.57
query22	2.75	1.86	2.68
query23	17.07	0.94	0.90
query24	3.54	0.42	1.44
query25	0.24	0.37	0.04
query26	0.34	0.15	0.14
query27	0.04	0.05	0.04
query28	10.58	1.10	1.07
query29	12.58	3.27	3.24
query30	0.25	0.06	0.06
query31	2.84	0.38	0.38
query32	3.25	0.46	0.48
query33	3.05	3.05	3.24
query34	17.05	4.54	4.53
query35	4.55	4.44	4.54
query36	0.65	0.48	0.48
query37	0.09	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 107.59 s
Total hot run time: 32.35 s

airborne12 · 2024-12-19T16:48:00Z

run buildall

github-actions · 2024-12-19T16:53:26Z

clang-tidy review says "All clean, LGTM! 👍"

doris-robot · 2024-12-19T18:38:07Z

TPC-H: Total hot run time: 39933 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 143caa322097174d450ebd8a1be4f1dde3c7ab7f, data reload: false
------ Round 1 ----------------------------------
q1	17582	7509	7323	7323
q2	2067	184	176	176
q3	10692	1102	1140	1102
q4	10554	731	748	731
q5	7640	2739	2672	2672
q6	244	149	146	146
q7	1001	626	600	600
q8	9260	1892	1899	1892
q9	6667	6401	6474	6401
q10	7027	2292	2286	2286
q11	469	268	259	259
q12	424	217	220	217
q13	17755	2955	2942	2942
q14	249	209	209	209
q15	571	510	491	491
q16	672	585	587	585
q17	978	628	509	509
q18	7473	6819	6816	6816
q19	1400	1013	917	917
q20	455	187	176	176
q21	3999	3229	3162	3162
q22	371	327	321	321
Total cold run time: 107550 ms
Total hot run time: 39933 ms
----- Round 2, with runtime_filter_mode=off -----
q1	7254	7268	7227	7227
q2	328	229	234	229
q3	2918	2781	2949	2781
q4	2053	1834	1833	1833
q5	5697	5715	5690	5690
q6	228	142	141	141
q7	2281	1791	1813	1791
q8	3410	3556	3540	3540
q9	8819	8953	9034	8953
q10	3578	3556	3546	3546
q11	598	490	519	490
q12	837	582	573	573
q13	12807	3135	3062	3062
q14	307	288	276	276
q15	561	505	507	505
q16	697	658	655	655
q17	1845	1640	1625	1625
q18	8386	7731	7846	7731
q19	1736	1563	1452	1452
q20	2067	1907	1892	1892
q21	5697	5631	5520	5520
q22	676	607	628	607
Total cold run time: 72780 ms
Total hot run time: 60119 ms

doris-robot · 2024-12-19T18:46:10Z

TeamCity be ut coverage result:
Function Coverage: 38.87% (10130/26062)
Line Coverage: 29.80% (85237/285997)
Region Coverage: 28.90% (43470/150399)
Branch Coverage: 25.44% (22168/87154)
Coverage Report: http://coverage.selectdb-in.cc/coverage/143caa322097174d450ebd8a1be4f1dde3c7ab7f_143caa322097174d450ebd8a1be4f1dde3c7ab7f/report/index.html

doris-robot · 2024-12-19T18:50:27Z

TPC-DS: Total hot run time: 196586 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 143caa322097174d450ebd8a1be4f1dde3c7ab7f, data reload: false
query1	1307	931	936	931
query2	6218	2349	2402	2349
query3	10975	4623	4701	4623
query4	32909	23375	23392	23375
query5	3995	488	486	486
query6	289	185	182	182
query7	3994	298	309	298
query8	313	242	231	231
query9	9556	2604	2613	2604
query10	469	240	243	240
query11	17730	15127	15188	15127
query12	157	105	99	99
query13	1564	414	408	408
query14	10289	7101	7319	7101
query15	279	194	217	194
query16	8109	448	428	428
query17	1585	608	599	599
query18	2178	340	322	322
query19	384	166	181	166
query20	127	127	126	126
query21	211	111	114	111
query22	4645	4517	4554	4517
query23	34678	33721	33769	33721
query24	10528	2640	2537	2537
query25	673	388	403	388
query26	749	158	162	158
query27	2240	331	330	330
query28	7109	2434	2404	2404
query29	766	417	408	408
query30	232	149	149	149
query31	1024	835	852	835
query32	102	58	53	53
query33	793	306	284	284
query34	1050	547	524	524
query35	960	746	785	746
query36	1119	937	972	937
query37	140	79	73	73
query38	4128	4168	4210	4168
query39	1514	1423	1432	1423
query40	207	104	106	104
query41	46	45	44	44
query42	118	108	103	103
query43	555	506	495	495
query44	1301	838	849	838
query45	190	167	173	167
query46	1203	716	768	716
query47	2037	1958	1936	1936
query48	420	330	325	325
query49	951	384	377	377
query50	834	399	388	388
query51	7357	7276	7285	7276
query52	110	93	96	93
query53	271	193	178	178
query54	1107	423	420	420
query55	76	74	83	74
query56	276	247	244	244
query57	1297	1174	1164	1164
query58	236	214	226	214
query59	3413	3204	3165	3165
query60	280	255	253	253
query61	107	111	105	105
query62	901	710	699	699
query63	224	199	191	191
query64	3963	696	654	654
query65	3317	3286	3291	3286
query66	761	312	311	311
query67	16498	15672	15477	15477
query68	5965	563	560	560
query69	498	258	246	246
query70	1171	1111	1103	1103
query71	500	251	249	249
query72	6542	4095	4093	4093
query73	827	355	368	355
query74	10078	8875	8870	8870
query75	4127	2607	2658	2607
query76	4351	1089	1124	1089
query77	671	280	270	270
query78	10228	9355	9418	9355
query79	1985	603	591	591
query80	1340	413	493	413
query81	510	241	234	234
query82	461	116	114	114
query83	189	141	144	141
query84	290	69	66	66
query85	1063	297	309	297
query86	358	287	290	287
query87	4705	4513	4307	4307
query88	4106	2199	2193	2193
query89	432	289	279	279
query90	2117	184	183	183
query91	135	103	104	103
query92	67	51	50	50
query93	4021	546	543	543
query94	856	281	291	281
query95	352	270	250	250
query96	662	276	278	276
query97	2878	2713	2743	2713
query98	219	194	186	186
query99	1616	1334	1330	1330
Total cold run time: 306464 ms
Total hot run time: 196586 ms

doris-robot · 2024-12-19T18:55:56Z

ClickBench: Total hot run time: 32.22 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 143caa322097174d450ebd8a1be4f1dde3c7ab7f, data reload: false
query1	0.04	0.04	0.03
query2	0.08	0.03	0.03
query3	0.24	0.07	0.07
query4	1.60	0.11	0.11
query5	0.44	0.40	0.39
query6	1.15	0.64	0.66
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.59	0.51	0.51
query10	0.55	0.58	0.56
query11	0.14	0.11	0.11
query12	0.14	0.11	0.10
query13	0.61	0.63	0.61
query14	2.73	2.75	2.87
query15	0.88	0.82	0.82
query16	0.39	0.37	0.39
query17	1.07	0.96	1.00
query18	0.22	0.22	0.21
query19	1.86	1.85	1.96
query20	0.01	0.02	0.01
query21	15.36	0.61	0.58
query22	2.66	1.68	1.73
query23	17.23	0.90	0.88
query24	3.28	0.64	2.02
query25	0.26	0.22	0.17
query26	0.28	0.14	0.13
query27	0.04	0.04	0.05
query28	9.82	1.10	1.07
query29	12.62	3.20	3.20
query30	0.24	0.06	0.07
query31	2.86	0.39	0.39
query32	3.24	0.46	0.46
query33	3.18	3.08	3.10
query34	16.99	4.45	4.47
query35	4.50	4.50	4.45
query36	0.68	0.48	0.48
query37	0.09	0.05	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.53 s
Total hot run time: 32.22 s

airborne12 · 2024-12-20T03:34:19Z

run buildall

airborne12 · 2024-12-20T04:18:49Z

run buildall

doris-robot · 2024-12-20T04:38:24Z

TPC-H: Total hot run time: 39670 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7edff929b4157738599b0fe8e972db202472314e, data reload: false
------ Round 1 ----------------------------------
q1	17599	7599	7296	7296
q2	2050	176	174	174
q3	10815	1083	1178	1083
q4	10526	775	703	703
q5	7621	2683	2698	2683
q6	236	151	149	149
q7	994	619	607	607
q8	9236	1847	1900	1847
q9	6603	6405	6443	6405
q10	7061	2306	2318	2306
q11	465	249	246	246
q12	440	224	218	218
q13	17758	2934	3002	2934
q14	254	210	216	210
q15	569	496	494	494
q16	650	574	566	566
q17	970	579	513	513
q18	7319	6789	6777	6777
q19	1349	1025	999	999
q20	474	177	182	177
q21	4032	3116	2982	2982
q22	374	316	301	301
Total cold run time: 107395 ms
Total hot run time: 39670 ms
----- Round 2, with runtime_filter_mode=off -----
q1	7431	7331	7200	7200
q2	332	224	232	224
q3	2916	2815	2952	2815
q4	2125	1883	1895	1883
q5	5643	5678	5611	5611
q6	222	148	143	143
q7	2239	1846	1801	1801
q8	3404	3561	3507	3507
q9	8866	9026	8979	8979
q10	3628	3611	3575	3575
q11	605	500	509	500
q12	834	631	617	617
q13	12787	3141	3157	3141
q14	327	261	271	261
q15	577	500	505	500
q16	681	643	650	643
q17	1827	1649	1611	1611
q18	8345	7734	7692	7692
q19	1729	1601	1550	1550
q20	2063	1915	1918	1915
q21	5669	5572	5519	5519
q22	643	580	578	578
Total cold run time: 72893 ms
Total hot run time: 60265 ms

airborne12 · 2024-12-20T04:45:21Z

run buildall

airborne12 · 2024-12-20T04:57:30Z

run buildall

doris-robot · 2024-12-20T05:53:49Z

ClickBench: Total hot run time: 32.35 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit df0787586c90406072aef3a30533feaa8e5dc8e7, data reload: false
query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.61	0.10	0.11
query5	0.43	0.39	0.39
query6	1.14	0.65	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.57	0.49	0.50
query10	0.54	0.58	0.55
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.71	2.84	2.75
query15	0.89	0.82	0.83
query16	0.39	0.38	0.39
query17	1.02	1.05	1.04
query18	0.22	0.20	0.21
query19	2.02	1.90	1.94
query20	0.01	0.01	0.01
query21	15.36	0.62	0.58
query22	2.42	2.30	1.84
query23	17.04	0.95	0.68
query24	4.22	0.57	0.62
query25	0.20	0.24	0.15
query26	0.27	0.14	0.14
query27	0.05	0.05	0.04
query28	11.18	1.09	1.08
query29	12.59	3.29	3.29
query30	0.25	0.07	0.06
query31	2.86	0.40	0.39
query32	3.25	0.47	0.46
query33	3.12	3.04	3.12
query34	17.17	4.49	4.46
query35	4.52	4.55	4.57
query36	0.65	0.47	0.47
query37	0.10	0.06	0.06
query38	0.04	0.04	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.03	0.03
query43	0.03	0.02	0.03
Total cold run time: 108.5 s
Total hot run time: 32.35 s

eldenmoon

lgtm

airborne12 · 2024-12-20T07:30:15Z

run buildall

yiguolei

LGTM

github-actions · 2024-12-20T08:15:26Z

PR approved by at least one committer and no changes requested.

doris-robot · 2024-12-20T08:41:40Z

TeamCity be ut coverage result:
Function Coverage: 38.87% (10130/26062)
Line Coverage: 29.81% (85281/286107)
Region Coverage: 28.93% (43544/150497)
Branch Coverage: 25.44% (22170/87152)
Coverage Report: http://coverage.selectdb-in.cc/coverage/0129a80763487bf7599ce3d36106f1103da35b67_0129a80763487bf7599ce3d36106f1103da35b67/report/index.html

doris-robot · 2024-12-20T08:55:31Z

TPC-H: Total hot run time: 40149 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0129a80763487bf7599ce3d36106f1103da35b67, data reload: false
------ Round 1 ----------------------------------
q1	17631	7427	7305	7305
q2	2060	183	175	175
q3	10559	1087	1172	1087
q4	10595	754	766	754
q5	7608	2694	2731	2694
q6	243	152	147	147
q7	992	625	617	617
q8	9253	1873	1882	1873
q9	6514	6405	6409	6405
q10	7006	2272	2301	2272
q11	466	277	259	259
q12	429	224	224	224
q13	17774	2980	3021	2980
q14	262	219	207	207
q15	555	513	512	512
q16	663	594	595	594
q17	979	579	546	546
q18	7381	6678	6731	6678
q19	1354	969	1011	969
q20	465	189	192	189
q21	4058	3414	3343	3343
q22	373	325	319	319
Total cold run time: 107220 ms
Total hot run time: 40149 ms
----- Round 2, with runtime_filter_mode=off -----
q1	7304	7237	7220	7220
q2	335	229	233	229
q3	2915	2771	3011	2771
q4	2124	1843	1863	1843
q5	5660	5630	5701	5630
q6	237	148	149	148
q7	2216	1833	1828	1828
q8	3392	3593	3538	3538
q9	8884	9061	8930	8930
q10	3611	3587	3532	3532
q11	623	528	511	511
q12	801	641	593	593
q13	11948	3114	3099	3099
q14	311	278	287	278
q15	554	509	495	495
q16	703	638	649	638
q17	1877	1634	1612	1612
q18	8432	7924	7532	7532
q19	1765	1558	1578	1558
q20	2132	1875	1961	1875
q21	5566	5555	5455	5455
q22	659	580	585	580
Total cold run time: 72049 ms
Total hot run time: 59895 ms

doris-robot · 2024-12-20T09:07:41Z

TPC-DS: Total hot run time: 196294 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0129a80763487bf7599ce3d36106f1103da35b67, data reload: false
query1	1291	948	923	923
query2	6240	2316	2290	2290
query3	11033	4689	4759	4689
query4	33369	23552	23379	23379
query5	4512	478	476	476
query6	272	197	205	197
query7	3989	300	307	300
query8	304	244	239	239
query9	9271	2729	2726	2726
query10	470	245	251	245
query11	17799	15089	15476	15089
query12	162	108	103	103
query13	1587	444	418	418
query14	10045	6803	7286	6803
query15	269	185	199	185
query16	7578	471	470	470
query17	1707	579	603	579
query18	1335	304	318	304
query19	375	158	164	158
query20	134	114	128	114
query21	209	113	110	110
query22	5014	4822	4736	4736
query23	34415	33945	33917	33917
query24	9671	2570	2484	2484
query25	574	408	408	408
query26	713	152	154	152
query27	2128	330	340	330
query28	6561	2472	2478	2472
query29	702	421	414	414
query30	223	150	154	150
query31	1065	842	863	842
query32	107	56	57	56
query33	658	298	300	298
query34	954	510	525	510
query35	857	767	755	755
query36	1090	964	977	964
query37	120	76	71	71
query38	4200	4231	4190	4190
query39	1495	1439	1459	1439
query40	211	107	102	102
query41	49	43	42	42
query42	112	100	102	100
query43	531	495	495	495
query44	1205	856	840	840
query45	188	178	173	173
query46	1157	714	725	714
query47	2026	1906	1934	1906
query48	437	336	338	336
query49	932	412	399	399
query50	837	434	380	380
query51	7316	7129	7077	7077
query52	104	95	89	89
query53	257	199	183	183
query54	1248	418	423	418
query55	88	83	77	77
query56	259	238	249	238
query57	1271	1170	1150	1150
query58	241	219	244	219
query59	3298	3056	3122	3056
query60	269	252	255	252
query61	110	113	107	107
query62	903	685	732	685
query63	227	191	201	191
query64	3557	665	624	624
query65	3222	3153	3193	3153
query66	800	304	320	304
query67	16025	15556	15521	15521
query68	4485	583	538	538
query69	411	276	255	255
query70	1161	1128	1108	1108
query71	391	255	259	255
query72	6626	4013	4039	4013
query73	774	364	369	364
query74	9985	8763	8872	8763
query75	3372	2644	2663	2644
query76	2524	1238	1060	1060
query77	387	269	280	269
query78	10419	9454	9496	9454
query79	2527	598	618	598
query80	1154	416	435	416
query81	651	221	226	221
query82	846	115	129	115
query83	243	143	137	137
query84	225	71	68	68
query85	1610	298	293	293
query86	496	290	299	290
query87	4543	4324	4298	4298
query88	3765	2226	2204	2204
query89	432	291	294	291
query90	2062	193	186	186
query91	187	109	104	104
query92	66	50	49	49
query93	2516	540	538	538
query94	941	291	251	251
query95	361	246	245	245
query96	618	282	276	276
query97	2855	2701	2682	2682
query98	215	200	197	197
query99	1539	1296	1324	1296
Total cold run time: 297765 ms
Total hot run time: 196294 ms

doris-robot · 2024-12-20T09:13:13Z

ClickBench: Total hot run time: 33.36 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0129a80763487bf7599ce3d36106f1103da35b67, data reload: false
query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.60	0.11	0.10
query5	0.42	0.42	0.41
query6	1.19	0.65	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.51	0.52
query10	0.57	0.60	0.57
query11	0.14	0.10	0.10
query12	0.13	0.11	0.10
query13	0.60	0.61	0.59
query14	2.73	2.73	2.72
query15	0.88	0.81	0.81
query16	0.37	0.36	0.38
query17	1.07	1.04	1.06
query18	0.23	0.20	0.20
query19	1.88	1.85	1.88
query20	0.02	0.01	0.01
query21	15.39	0.60	0.60
query22	2.55	3.28	2.43
query23	16.78	1.19	0.81
query24	2.76	1.18	1.71
query25	0.22	0.24	0.06
query26	0.47	0.14	0.13
query27	0.05	0.04	0.03
query28	10.18	1.09	1.07
query29	12.57	3.27	3.23
query30	0.25	0.06	0.06
query31	2.87	0.37	0.38
query32	3.24	0.46	0.47
query33	3.08	3.05	3.11
query34	17.05	4.44	4.50
query35	4.47	4.47	4.48
query36	0.67	0.48	0.47
query37	0.10	0.07	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.13	0.13
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.91 s
Total hot run time: 33.36 s

eldenmoon

LGTM

cherry pick from #45675

…e#45757) cherry pick from apache#45675

eldenmoon previously approved these changes Dec 19, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Dec 19, 2024

github-actionsBot added the reviewed label Dec 19, 2024

airborne12 dismissed eldenmoon’s stale review via 365ffffDecember 19, 2024 15:06

github-actionsBot removed the approved Indicates a PR has been approved by one committer. label Dec 19, 2024

airborne12 force-pushed the opt-profile branch from 79eaad8 to 143caa3Compare December 19, 2024 16:47

eldenmoon previously approved these changes Dec 20, 2024
View reviewed changes

yiguolei reviewed Dec 20, 2024
View reviewed changes

Comment threadbe/src/olap/rowset/segment_v2/bloom_filter_index_reader.cpp

yiguolei reviewed Dec 20, 2024
View reviewed changes

Comment threadbe/src/olap/rowset/segment_v2/bloom_filter_index_reader.h Outdated

[opt](profile) add index page profile for io
51747fe

airborne12 dismissed eldenmoon’s stale review via 51747feDecember 20, 2024 06:56

airborne12 force-pushed the opt-profile branch from df07875 to 51747feCompare December 20, 2024 06:56

yiguolei reviewed Dec 20, 2024
View reviewed changes

Comment threadbe/src/olap/rowset/segment_v2/indexed_column_reader.h

[opt](profile) add index page profile for io
0129a80

yiguolei approved these changes Dec 20, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Dec 20, 2024

eldenmoon approved these changes Dec 20, 2024
View reviewed changes

yiguolei merged commit af11693 into apache:masterDec 20, 2024

yiguolei added the dev/3.0.x label Dec 20, 2024

github-actionsBot added the dev/3.0.x-conflict label Dec 20, 2024

airborne12 deleted the opt-profile branch December 21, 2024 07:49

airborne12 mentioned this pull request Dec 21, 2024
[opt](profile) add index page profile for io #45675 #45757
Merged

airborne12 added a commit that referenced this pull request Dec 23, 2024
[opt](profile) add index page profile for io#45675(#45757)
632f93a
cherry pick from #45675

airborne12 added dev/3.0.4-merged and removed dev/3.0.x dev/3.0.x-conflict labels Dec 23, 2024

gavinchou mentioned this pull request Feb 18, 2025
Release Notes 3.0.4 #48013
Closed

csun5285 pushed a commit to csun5285/doris that referenced this pull request Mar 28, 2025
pick [opt](profile) add index page profile for ioapache#45675(apach…
cb63055
…e#45757) cherry pick from apache#45675

HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
[opt](profile) add index page profile for io (apache#45675)
5318132

Uh oh!

Conversation

airborne12 commented Dec 19, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Dec 19, 2024

Uh oh!

airborne12 commented Dec 19, 2024

Uh oh!

github-actionsBot commented Dec 19, 2024

Uh oh!

eldenmoon left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Dec 19, 2024

Uh oh!

github-actionsBot commented Dec 19, 2024

Uh oh!

airborne12 commented Dec 19, 2024

Uh oh!

github-actionsBot commented Dec 19, 2024

Uh oh!

airborne12 commented Dec 19, 2024

Uh oh!

github-actionsBot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

airborne12 commented Dec 19, 2024

Uh oh!

github-actionsBot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

doris-robot commented Dec 19, 2024

Uh oh!

airborne12 commented Dec 20, 2024

Uh oh!

airborne12 commented Dec 20, 2024

Uh oh!

doris-robot commented Dec 20, 2024

Uh oh!

airborne12 commented Dec 20, 2024

Uh oh!

airborne12 commented Dec 20, 2024

Uh oh!

doris-robot commented Dec 20, 2024

Uh oh!

eldenmoon left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

airborne12 commented Dec 20, 2024

Uh oh!

yiguolei left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Dec 20, 2024

Uh oh!

doris-robot commented Dec 20, 2024

Uh oh!

doris-robot commented Dec 20, 2024

Uh oh!

doris-robot commented Dec 20, 2024

airborne12 commented Dec 19, 2024•
edited
Loading