[opt](olap) Optimize reading by rowids of Map Column by mrhhsg · Pull Request #59043 · apache/doris

mrhhsg · 2025-12-15T08:39:45Z

What problem does this PR solve?

Read as many consecutive rows as possible.

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2025-12-15T08:39:51Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

mrhhsg · 2025-12-15T08:39:55Z

run buildall

doris-robot · 2025-12-15T09:21:49Z

TPC-H: Total hot run time: 35123 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a3721e751814e2eb34e924760bba28d2320d82ff, data reload: false
------ Round 1 ----------------------------------
q1	17650	4185	4078	4078
q2	2070	362	241	241
q3	10100	1360	716	716
q4	10207	860	311	311
q5	7502	2291	2031	2031
q6	191	170	137	137
q7	990	836	707	707
q8	9366	1467	1166	1166
q9	7052	5305	5331	5305
q10	6792	2381	2000	2000
q11	526	326	296	296
q12	648	738	589	589
q13	17798	3698	3040	3040
q14	304	300	278	278
q15	590	527	517	517
q16	682	659	618	618
q17	686	857	526	526
q18	7614	7057	7131	7057
q19	1120	967	593	593
q20	398	370	250	250
q21	4304	3929	3717	3717
q22	1069	990	950	950
Total cold run time: 107659 ms
Total hot run time: 35123 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4070	4013	4046	4013
q2	318	413	325	325
q3	2145	2670	2248	2248
q4	1370	1771	1290	1290
q5	4239	4579	4821	4579
q6	300	178	134	134
q7	2098	1936	1772	1772
q8	2683	2676	2577	2577
q9	7812	7367	7444	7367
q10	3270	3243	2721	2721
q11	609	526	505	505
q12	707	736	645	645
q13	3557	3895	3350	3350
q14	289	310	269	269
q15	536	545	509	509
q16	667	714	645	645
q17	1209	1444	1474	1444
q18	8064	7529	7694	7529
q19	859	865	884	865
q20	2037	2044	1979	1979
q21	4921	4524	4093	4093
q22	1070	1006	984	984
Total cold run time: 52830 ms
Total hot run time: 49843 ms

doris-robot · 2025-12-15T09:32:47Z

TPC-DS: Total hot run time: 178459 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a3721e751814e2eb34e924760bba28d2320d82ff, data reload: false
query5	4441	626	466	466
query6	335	234	219	219
query7	4219	466	277	277
query8	309	251	247	247
query9	8730	2568	2559	2559
query10	493	367	329	329
query11	15343	14746	14624	14624
query12	173	118	118	118
query13	1268	503	407	407
query14	5581	3228	3020	3020
query14_1	2933	2821	2890	2821
query15	213	196	184	184
query16	879	483	417	417
query17	932	673	564	564
query18	2425	437	369	369
query19	227	232	212	212
query20	117	121	109	109
query21	211	140	112	112
query22	3979	3978	3890	3890
query23	16500	16219	15979	15979
query23_1	16027	15998	16115	15998
query24	7355	1655	1235	1235
query24_1	1242	1228	1217	1217
query25	555	487	434	434
query26	1242	292	175	175
query27	2726	469	314	314
query28	4516	2170	2145	2145
query29	821	583	473	473
query30	323	248	220	220
query31	841	706	639	639
query32	81	73	75	73
query33	556	349	302	302
query34	919	915	571	571
query35	771	830	724	724
query36	888	918	803	803
query37	127	92	75	75
query38	2882	2813	2868	2813
query39	759	733	731	731
query39_1	701	694	698	694
query40	224	139	122	122
query41	67	62	62	62
query42	107	116	107	107
query43	450	443	417	417
query44	1347	759	756	756
query45	193	184	181	181
query46	893	985	623	623
query47	1669	1672	1617	1617
query48	316	335	249	249
query49	661	437	343	343
query50	672	290	220	220
query51	3797	3815	3803	3803
query52	110	113	99	99
query53	319	348	291	291
query54	289	289	246	246
query55	90	78	72	72
query56	287	300	293	293
query57	1155	1132	1068	1068
query58	269	272	253	253
query59	2355	2454	2363	2363
query60	315	307	283	283
query61	194	155	155	155
query62	703	668	617	617
query63	334	294	300	294
query64	4989	1304	1013	1013
query65	3997	3948	3960	3948
query66	1480	438	312	312
query67	15170	14892	14793	14793
query68	2774	1046	765	765
query69	447	351	321	321
query70	1067	995	984	984
query71	334	319	297	297
query72	6122	4984	5132	4984
query73	499	560	315	315
query74	9012	8895	8706	8706
query75	3135	3198	2785	2785
query76	2840	1133	744	744
query77	374	392	300	300
query78	9410	9801	8943	8943
query79	1100	853	607	607
query80	1194	711	628	628
query81	559	270	234	234
query82	444	131	105	105
query83	364	254	237	237
query84	306	120	97	97
query85	934	505	460	460
query86	383	298	288	288
query87	2975	3013	2949	2949
query88	3300	2307	2257	2257
query89	459	439	394	394
query90	2032	161	160	160
query91	174	163	150	150
query92	79	66	61	61
query93	1078	891	554	554
query94	515	300	258	258
query95	570	339	306	306
query96	598	453	210	210
query97	2264	2296	2216	2216
query98	221	198	188	188
query99	1263	1287	1191	1191
Total cold run time: 252086 ms
Total hot run time: 178459 ms

doris-robot · 2025-12-15T09:37:50Z

ClickBench: Total hot run time: 27.4 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a3721e751814e2eb34e924760bba28d2320d82ff, data reload: false
query1	0.05	0.06	0.04
query2	0.10	0.04	0.05
query3	0.26	0.09	0.08
query4	1.60	0.11	0.11
query5	0.27	0.26	0.27
query6	1.16	0.63	0.64
query7	0.03	0.02	0.02
query8	0.05	0.04	0.05
query9	0.57	0.51	0.52
query10	0.57	0.56	0.56
query11	0.15	0.11	0.11
query12	0.14	0.12	0.11
query13	0.62	0.60	0.61
query14	0.99	1.00	0.99
query15	0.83	0.80	0.80
query16	0.39	0.40	0.42
query17	1.07	1.07	1.06
query18	0.24	0.22	0.22
query19	1.97	1.82	1.76
query20	0.02	0.02	0.01
query21	15.44	0.30	0.14
query22	4.94	0.04	0.04
query23	15.89	0.29	0.10
query24	1.92	0.31	0.27
query25	0.06	0.05	0.06
query26	0.15	0.13	0.14
query27	0.08	0.05	0.05
query28	3.20	1.24	1.03
query29	12.59	4.16	3.33
query30	0.29	0.14	0.12
query31	2.81	0.65	0.40
query32	3.23	0.56	0.46
query33	3.08	3.16	2.99
query34	17.04	5.28	4.55
query35	4.55	4.56	4.62
query36	0.67	0.49	0.49
query37	0.11	0.07	0.07
query38	0.06	0.04	0.03
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.09	0.04	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 97.57 s
Total hot run time: 27.4 s

doris-robot · 2025-12-15T10:30:34Z

BE UT Coverage Report

Increment line coverage 93.02% (40/43) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.45% (18841/35248)
Line Coverage	39.22% (174433/444753)
Region Coverage	33.85% (135057/398957)
Branch Coverage	34.79% (58110/167018)

hello-stephen · 2025-12-15T11:39:53Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (43/43) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	58.36% (20159/34542)
Line Coverage	44.12% (195935/444131)
Region Coverage	39.09% (157774/403590)
Branch Coverage	39.62% (66502/167833)

mrhhsg · 2025-12-16T01:28:39Z

run buildall

doris-robot · 2025-12-16T02:31:25Z

TPC-H: Total hot run time: 34966 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a3721e751814e2eb34e924760bba28d2320d82ff, data reload: false
------ Round 1 ----------------------------------
q1	17627	4265	4262	4262
q2	2013	363	239	239
q3	10198	1370	749	749
q4	10237	909	314	314
q5	7487	2116	1954	1954
q6	187	166	140	140
q7	1007	848	721	721
q8	9356	1444	1120	1120
q9	7185	5381	5321	5321
q10	6830	2376	1984	1984
q11	535	321	297	297
q12	666	734	584	584
q13	17793	3648	3014	3014
q14	285	288	264	264
q15	598	541	507	507
q16	685	684	643	643
q17	697	861	563	563
q18	7752	7020	6939	6939
q19	1117	972	617	617
q20	404	358	242	242
q21	4167	3957	3527	3527
q22	1020	1009	965	965
Total cold run time: 107846 ms
Total hot run time: 34966 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4106	4040	4087	4040
q2	338	398	313	313
q3	2146	2707	2236	2236
q4	1302	1746	1283	1283
q5	4254	4553	4782	4553
q6	230	188	130	130
q7	2058	1956	1864	1864
q8	2682	2566	2549	2549
q9	7551	7452	7680	7452
q10	3119	3271	2760	2760
q11	607	517	497	497
q12	692	766	751	751
q13	3603	3947	3341	3341
q14	293	295	288	288
q15	565	523	515	515
q16	659	820	673	673
q17	1226	1434	1482	1434
q18	7882	7759	7490	7490
q19	906	910	887	887
q20	2003	2186	1899	1899
q21	4836	4381	4200	4200
q22	1092	1034	979	979
Total cold run time: 52150 ms
Total hot run time: 50134 ms

doris-robot · 2025-12-16T02:42:31Z

TPC-DS: Total hot run time: 178689 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a3721e751814e2eb34e924760bba28d2320d82ff, data reload: false
query5	4433	639	441	441
query6	337	236	228	228
query7	4233	471	279	279
query8	318	259	258	258
query9	8751	2597	2594	2594
query10	490	387	331	331
query11	15404	14733	14767	14733
query12	180	116	115	115
query13	1265	498	406	406
query14	6032	3236	3026	3026
query14_1	2899	2934	2908	2908
query15	208	203	179	179
query16	894	484	516	484
query17	1134	725	636	636
query18	2476	436	357	357
query19	242	233	205	205
query20	119	117	115	115
query21	219	141	118	118
query22	3977	3893	3858	3858
query23	16558	16150	15958	15958
query23_1	16202	16182	16182	16182
query24	7377	1678	1254	1254
query24_1	1249	1234	1262	1234
query25	602	513	449	449
query26	1253	278	178	178
query27	2734	461	320	320
query28	4454	2153	2137	2137
query29	828	579	464	464
query30	319	247	226	226
query31	830	729	634	634
query32	82	72	76	72
query33	617	342	292	292
query34	903	889	550	550
query35	793	827	723	723
query36	860	907	832	832
query37	128	95	79	79
query38	2853	2873	2832	2832
query39	762	813	704	704
query39_1	700	696	691	691
query40	223	136	121	121
query41	67	60	63	60
query42	107	108	106	106
query43	443	433	402	402
query44	1341	748	741	741
query45	193	194	178	178
query46	876	982	613	613
query47	1640	1677	1618	1618
query48	311	321	250	250
query49	626	427	350	350
query50	670	303	219	219
query51	3869	3913	3892	3892
query52	106	111	99	99
query53	349	344	311	311
query54	291	257	247	247
query55	82	75	73	73
query56	304	298	315	298
query57	1140	1149	1064	1064
query58	267	249	252	249
query59	2311	2456	2334	2334
query60	316	308	295	295
query61	165	182	155	155
query62	698	680	634	634
query63	341	300	308	300
query64	4992	1312	1021	1021
query65	4015	3960	3966	3960
query66	1468	446	309	309
query67	15324	14957	14790	14790
query68	8445	1017	725	725
query69	494	348	317	317
query70	1066	987	973	973
query71	369	313	294	294
query72	6231	4892	5036	4892
query73	701	591	314	314
query74	8615	8887	8563	8563
query75	3200	3137	2767	2767
query76	3989	1139	758	758
query77	590	387	296	296
query78	9391	9557	8891	8891
query79	1405	902	627	627
query80	757	656	547	547
query81	528	276	232	232
query82	210	135	103	103
query83	269	260	239	239
query84	257	114	101	101
query85	904	510	483	483
query86	373	298	261	261
query87	3055	3067	2934	2934
query88	3266	2299	2265	2265
query89	476	435	395	395
query90	2015	167	159	159
query91	170	166	154	154
query92	80	71	65	65
query93	1074	922	561	561
query94	478	313	292	292
query95	585	332	320	320
query96	609	492	218	218
query97	2300	2327	2278	2278
query98	204	194	193	193
query99	1286	1298	1208	1208
Total cold run time: 259503 ms
Total hot run time: 178689 ms

doris-robot · 2025-12-16T02:47:33Z

ClickBench: Total hot run time: 27.26 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a3721e751814e2eb34e924760bba28d2320d82ff, data reload: false
query1	0.05	0.04	0.04
query2	0.10	0.06	0.05
query3	0.25	0.09	0.08
query4	1.60	0.11	0.11
query5	0.26	0.25	0.26
query6	1.14	0.63	0.63
query7	0.03	0.03	0.02
query8	0.05	0.04	0.04
query9	0.57	0.49	0.51
query10	0.56	0.55	0.56
query11	0.14	0.10	0.11
query12	0.15	0.12	0.12
query13	0.62	0.60	0.61
query14	0.99	0.99	0.98
query15	0.81	0.79	0.82
query16	0.41	0.43	0.43
query17	1.00	0.98	1.01
query18	0.24	0.22	0.22
query19	1.82	1.79	1.73
query20	0.02	0.01	0.02
query21	15.43	0.29	0.14
query22	4.74	0.05	0.05
query23	16.08	0.29	0.10
query24	2.07	0.33	0.31
query25	0.07	0.05	0.08
query26	0.15	0.13	0.13
query27	0.06	0.06	0.06
query28	3.37	1.19	1.03
query29	12.55	4.06	3.27
query30	0.27	0.14	0.11
query31	2.82	0.63	0.39
query32	3.23	0.56	0.46
query33	3.04	3.06	3.00
query34	16.71	5.12	4.54
query35	4.68	4.59	4.56
query36	0.67	0.49	0.50
query37	0.11	0.07	0.07
query38	0.07	0.05	0.04
query39	0.04	0.04	0.03
query40	0.17	0.14	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 97.31 s
Total hot run time: 27.26 s

hello-stephen · 2025-12-16T04:01:58Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (43/43) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	58.34% (20166/34564)
Line Coverage	44.08% (195839/444239)
Region Coverage	39.06% (157673/403669)
Branch Coverage	39.58% (66436/167856)

hello-stephen · 2025-12-16T04:24:56Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (43/43) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	58.34% (20166/34564)
Line Coverage	44.08% (195839/444239)
Region Coverage	39.06% (157673/403669)
Branch Coverage	39.58% (66436/167856)

hello-stephen · 2025-12-16T04:48:06Z

BE Regression && UT Coverage Report

Increment line coverage 93.02% (40/43) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	58.40% (20184/34564)
Line Coverage	44.11% (195963/444239)
Region Coverage	39.02% (157522/403669)
Branch Coverage	39.62% (66506/167856)

hello-stephen · 2025-12-16T10:33:27Z

BE UT Coverage Report

Increment line coverage 93.02% (40/43) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.42% (18838/35267)
Line Coverage	39.22% (174503/444985)
Region Coverage	33.78% (135091/399860)
Branch Coverage	34.68% (58165/167699)

hello-stephen · 2025-12-16T10:39:05Z

BE Regression && UT Coverage Report

Increment line coverage 93.02% (40/43) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	58.23% (20126/34563)
Line Coverage	43.93% (195132/444226)
Region Coverage	38.81% (156673/403668)
Branch Coverage	39.42% (66175/167856)

mrhhsg · 2025-12-17T09:00:48Z

run buildall

doris-robot · 2025-12-17T09:25:30Z

TPC-H: Total hot run time: 36270 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 73f82947a6a441bcd7fca8ceedca6aca78468b63, data reload: false
------ Round 1 ----------------------------------
q1	17622	4169	4062	4062
q2	2045	360	253	253
q3	10149	1338	733	733
q4	10235	826	307	307
q5	7503	2156	1934	1934
q6	192	170	137	137
q7	1028	853	723	723
q8	9349	1479	1209	1209
q9	7105	5375	5420	5375
q10	6864	2421	1960	1960
q11	541	326	303	303
q12	723	722	574	574
q13	17787	3687	3042	3042
q14	298	301	272	272
q15	597	530	512	512
q16	702	704	650	650
q17	699	837	540	540
q18	7661	7379	8111	7379
q19	1249	1037	661	661
q20	416	366	275	275
q21	4567	4392	4344	4344
q22	1131	1025	1078	1025
Total cold run time: 108463 ms
Total hot run time: 36270 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4399	4271	4382	4271
q2	336	414	325	325
q3	2511	3033	2486	2486
q4	1492	1934	1462	1462
q5	4552	4516	4425	4425
q6	208	163	131	131
q7	2009	1959	1836	1836
q8	2769	2557	2649	2557
q9	7327	7533	7704	7533
q10	3079	3208	2811	2811
q11	608	506	497	497
q12	653	699	607	607
q13	3357	3661	3021	3021
q14	270	282	262	262
q15	545	501	496	496
q16	651	656	600	600
q17	1120	1369	1366	1366
q18	7316	7216	7171	7171
q19	848	784	819	784
q20	1890	1997	1805	1805
q21	4657	4247	4130	4130
q22	1117	1064	990	990
Total cold run time: 51714 ms
Total hot run time: 49566 ms

doris-robot · 2025-12-17T09:36:36Z

TPC-DS: Total hot run time: 179088 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 73f82947a6a441bcd7fca8ceedca6aca78468b63, data reload: false
query5	5138	596	441	441
query6	340	240	223	223
query7	4235	465	277	277
query8	327	260	270	260
query9	8794	2564	2544	2544
query10	486	376	345	345
query11	15455	14896	15102	14896
query12	188	123	117	117
query13	1269	498	402	402
query14	6592	3032	2774	2774
query14_1	2648	2671	2674	2671
query15	209	199	187	187
query16	800	471	477	471
query17	1110	736	608	608
query18	2716	469	356	356
query19	233	233	207	207
query20	119	111	113	111
query21	226	144	117	117
query22	3960	4059	4028	4028
query23	16533	16165	16036	16036
query23_1	16006	16130	16006	16006
query24	7249	1666	1225	1225
query24_1	1250	1249	1246	1246
query25	581	540	449	449
query26	1255	274	175	175
query27	2731	467	309	309
query28	4502	2146	2127	2127
query29	905	525	454	454
query30	322	243	219	219
query31	828	687	622	622
query32	84	68	68	68
query33	528	350	295	295
query34	899	908	539	539
query35	774	862	721	721
query36	882	924	795	795
query37	130	98	82	82
query38	2855	2896	2837	2837
query39	769	749	707	707
query39_1	677	710	725	710
query40	222	136	118	118
query41	73	62	62	62
query42	110	110	108	108
query43	426	442	410	410
query44	1334	746	742	742
query45	194	186	187	186
query46	869	990	614	614
query47	1644	1679	1608	1608
query48	313	325	260	260
query49	630	439	355	355
query50	677	305	227	227
query51	3789	3801	3829	3801
query52	113	115	104	104
query53	334	353	307	307
query54	303	267	286	267
query55	80	77	78	77
query56	311	293	318	293
query57	1165	1139	1069	1069
query58	279	253	248	248
query59	2345	2478	2317	2317
query60	304	309	290	290
query61	158	156	161	156
query62	695	669	642	642
query63	326	292	302	292
query64	4924	1328	1017	1017
query65	4016	3930	3986	3930
query66	1378	443	314	314
query67	15409	14970	14981	14970
query68	6435	996	730	730
query69	488	346	314	314
query70	1070	1017	949	949
query71	379	313	296	296
query72	6093	5102	5208	5102
query73	723	646	306	306
query74	8894	8728	8545	8545
query75	3198	3186	2813	2813
query76	3892	1125	738	738
query77	515	400	302	302
query78	9338	9682	8930	8930
query79	1080	892	614	614
query80	723	659	562	562
query81	492	264	234	234
query82	233	136	111	111
query83	264	257	245	245
query84	264	128	101	101
query85	897	514	462	462
query86	307	294	288	288
query87	3054	3129	2993	2993
query88	3230	2290	2272	2272
query89	470	435	393	393
query90	1995	158	161	158
query91	179	171	143	143
query92	73	66	64	64
query93	1009	953	567	567
query94	489	306	288	288
query95	567	384	307	307
query96	610	493	213	213
query97	2238	2311	2232	2232
query98	208	198	199	198
query99	1288	1261	1203	1203
Total cold run time: 257735 ms
Total hot run time: 179088 ms

doris-robot · 2025-12-17T09:41:39Z

ClickBench: Total hot run time: 27.19 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 73f82947a6a441bcd7fca8ceedca6aca78468b63, data reload: false
query1	0.06	0.05	0.05
query2	0.11	0.05	0.05
query3	0.27	0.10	0.09
query4	1.60	0.11	0.11
query5	0.26	0.24	0.26
query6	1.19	0.62	0.62
query7	0.03	0.03	0.03
query8	0.06	0.04	0.04
query9	0.56	0.52	0.52
query10	0.55	0.53	0.57
query11	0.16	0.12	0.10
query12	0.15	0.12	0.12
query13	0.63	0.60	0.60
query14	0.99	1.00	0.98
query15	0.83	0.81	0.82
query16	0.40	0.41	0.41
query17	1.05	1.06	0.98
query18	0.23	0.21	0.22
query19	1.95	1.76	1.80
query20	0.02	0.02	0.01
query21	15.45	0.28	0.14
query22	4.93	0.06	0.05
query23	16.30	0.28	0.10
query24	0.97	0.55	0.20
query25	0.11	0.06	0.06
query26	0.15	0.13	0.13
query27	0.09	0.04	0.06
query28	3.22	1.23	1.04
query29	12.58	3.94	3.24
query30	0.28	0.14	0.12
query31	2.83	0.62	0.39
query32	3.23	0.54	0.46
query33	2.94	3.07	3.05
query34	17.05	5.17	4.48
query35	4.56	4.63	4.58
query36	0.68	0.50	0.48
query37	0.10	0.07	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.09	0.04	0.03
query42	0.05	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 97.02 s
Total hot run time: 27.19 s

mrhhsg · 2025-12-17T13:01:42Z

run buildall

doris-robot · 2025-12-17T13:22:23Z

TPC-H: Total hot run time: 36090 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2ea18e5d6e8c17f1498a1bd733dc0b10f01ab156, data reload: false
------ Round 1 ----------------------------------
q1	17624	4265	4039	4039
q2	2041	359	246	246
q3	10173	1345	746	746
q4	10218	841	313	313
q5	7625	2122	1922	1922
q6	195	172	139	139
q7	1005	864	699	699
q8	9345	1425	1140	1140
q9	7108	5329	5354	5329
q10	6792	2403	1990	1990
q11	535	337	305	305
q12	679	726	552	552
q13	17755	3653	3016	3016
q14	287	305	271	271
q15	574	509	512	509
q16	689	683	625	625
q17	679	783	543	543
q18	7687	7607	7851	7607
q19	1253	1008	647	647
q20	444	368	265	265
q21	4492	4402	4141	4141
q22	1120	1046	1048	1046
Total cold run time: 108320 ms
Total hot run time: 36090 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4266	4236	4294	4236
q2	341	435	335	335
q3	2346	2883	2448	2448
q4	1496	1863	1406	1406
q5	4793	4427	4593	4427
q6	208	171	123	123
q7	1987	1970	1822	1822
q8	2691	2475	2570	2475
q9	7474	7427	7475	7427
q10	3105	3239	2880	2880
q11	590	530	487	487
q12	628	720	601	601
q13	3298	3601	2993	2993
q14	284	293	253	253
q15	536	544	487	487
q16	613	662	598	598
q17	1105	1369	1388	1369
q18	7273	7163	7089	7089
q19	811	802	841	802
q20	1895	1941	1852	1852
q21	4556	4172	4067	4067
q22	1091	1031	960	960
Total cold run time: 51387 ms
Total hot run time: 49137 ms

doris-robot · 2025-12-17T13:33:26Z

TPC-DS: Total hot run time: 178782 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2ea18e5d6e8c17f1498a1bd733dc0b10f01ab156, data reload: false
query5	4404	590	434	434
query6	339	231	240	231
query7	4236	461	271	271
query8	315	258	246	246
query9	8742	2518	2548	2518
query10	497	372	330	330
query11	15151	14787	14878	14787
query12	183	112	114	112
query13	1246	498	403	403
query14	6340	3033	2737	2737
query14_1	2653	2657	2649	2649
query15	215	200	179	179
query16	789	442	442	442
query17	1130	736	604	604
query18	2548	450	353	353
query19	246	245	215	215
query20	122	118	112	112
query21	218	143	120	120
query22	3844	3891	3902	3891
query23	16630	16134	15979	15979
query23_1	16066	16148	15994	15994
query24	7370	1658	1246	1246
query24_1	1276	1255	1258	1255
query25	593	521	460	460
query26	1252	269	168	168
query27	2762	476	321	321
query28	4424	2146	2136	2136
query29	846	575	475	475
query30	323	244	215	215
query31	872	712	642	642
query32	85	75	74	74
query33	558	359	324	324
query34	921	898	559	559
query35	779	826	737	737
query36	888	901	804	804
query37	127	101	92	92
query38	2864	2886	2794	2794
query39	767	746	734	734
query39_1	711	711	728	711
query40	228	145	128	128
query41	73	73	68	68
query42	110	108	149	108
query43	440	440	408	408
query44	1324	744	751	744
query45	192	205	181	181
query46	880	975	622	622
query47	1634	1668	1602	1602
query48	321	329	249	249
query49	630	494	350	350
query50	645	312	222	222
query51	3890	3772	3857	3772
query52	112	108	105	105
query53	315	349	298	298
query54	292	256	245	245
query55	81	81	72	72
query56	305	300	302	300
query57	1171	1163	1066	1066
query58	272	257	249	249
query59	2421	2543	2426	2426
query60	324	308	292	292
query61	173	162	159	159
query62	730	674	644	644
query63	336	301	301	301
query64	5025	1332	1018	1018
query65	3992	3982	3937	3937
query66	1422	443	325	325
query67	15262	15164	14854	14854
query68	5632	1007	728	728
query69	494	340	320	320
query70	1076	1013	1001	1001
query71	370	312	278	278
query72	6327	4994	4973	4973
query73	666	587	323	323
query74	8863	8872	8602	8602
query75	3207	3168	2826	2826
query76	3901	1137	721	721
query77	516	380	298	298
query78	9392	9616	8881	8881
query79	1294	887	611	611
query80	706	663	556	556
query81	511	266	239	239
query82	197	140	103	103
query83	264	255	243	243
query84	263	113	105	105
query85	932	503	469	469
query86	314	301	274	274
query87	3021	2988	2984	2984
query88	3215	2304	2276	2276
query89	472	423	394	394
query90	2016	161	158	158
query91	178	180	145	145
query92	79	69	61	61
query93	1016	896	571	571
query94	483	297	276	276
query95	575	345	316	316
query96	592	464	214	214
query97	2310	2281	2228	2228
query98	205	197	196	196
query99	1274	1319	1211	1211
Total cold run time: 256372 ms
Total hot run time: 178782 ms

doris-robot · 2025-12-17T13:38:30Z

ClickBench: Total hot run time: 27.94 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2ea18e5d6e8c17f1498a1bd733dc0b10f01ab156, data reload: false
query1	0.05	0.06	0.05
query2	0.10	0.05	0.05
query3	0.25	0.09	0.08
query4	1.61	0.11	0.11
query5	0.30	0.25	0.27
query6	1.17	0.65	0.63
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.57	0.50	0.50
query10	0.55	0.54	0.55
query11	0.15	0.10	0.12
query12	0.15	0.12	0.11
query13	0.62	0.61	0.61
query14	1.00	1.00	0.99
query15	0.81	0.81	0.81
query16	0.40	0.40	0.40
query17	1.05	1.08	1.06
query18	0.23	0.22	0.21
query19	1.89	1.86	1.86
query20	0.01	0.01	0.02
query21	15.44	0.30	0.14
query22	4.77	0.05	0.04
query23	15.94	0.30	0.10
query24	0.94	0.70	0.75
query25	0.12	0.09	0.12
query26	0.14	0.13	0.14
query27	0.07	0.06	0.06
query28	5.18	1.23	1.02
query29	12.59	4.10	3.29
query30	0.28	0.14	0.12
query31	2.82	0.61	0.41
query32	3.23	0.56	0.46
query33	3.06	3.00	3.09
query34	17.05	5.15	4.52
query35	4.58	4.58	4.61
query36	0.66	0.50	0.49
query37	0.11	0.07	0.06
query38	0.08	0.04	0.04
query39	0.04	0.03	0.03
query40	0.16	0.15	0.14
query41	0.10	0.03	0.03
query42	0.04	0.03	0.03
query43	0.05	0.03	0.04
Total cold run time: 98.45 s
Total hot run time: 27.94 s

hello-stephen · 2025-12-17T14:10:47Z

BE UT Coverage Report

Increment line coverage 94.12% (48/51) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	53.42% (18835/35257)
Line Coverage	39.20% (174402/444848)
Region Coverage	33.79% (135050/399700)
Branch Coverage	34.68% (58150/167679)

hello-stephen · 2025-12-17T16:22:05Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (51/51) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	72.34% (24995/34550)
Line Coverage	59.08% (262443/444233)
Region Coverage	53.91% (217979/404327)
Branch Coverage	55.50% (93519/168490)

hello-stephen · 2025-12-17T16:43:09Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (51/51) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	72.34% (24994/34550)
Line Coverage	59.07% (262428/444233)
Region Coverage	53.92% (218003/404327)
Branch Coverage	55.50% (93517/168490)

eldenmoon

LGTM

github-actions · 2025-12-18T01:49:59Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-12-18T01:50:01Z

PR approved by anyone and no changes requested.

### What problem does this PR solve? Read as many consecutive rows as possible. Problem Summary: ### Release note None ### Check List (For Author) - Test  - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason  - Behavior changed: - [ ] No. - [ ] Yes.  - Does this need documentation? - [ ] No. - [ ] Yes.  ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label

…rning (#59286) ### What problem does this PR solve? Problem Summary: ### Release note Cherry-pick #58370 #58354 #59043 #58851 #58485 #58682 #58614 #58373 #57204 #58719 #58471 #58573 #58657 ### Check List (For Author) - Test  - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason  - Behavior changed: - [ ] No. - [ ] Yes.  - Does this need documentation? - [ ] No. - [ ] Yes.  ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label  --------- Co-authored-by: 924060929 <lanhuajian@selectdb.com> Co-authored-by: Jerry Hu <mrhhsg@gmail.com> Co-authored-by: Jerry Hu <hushenggang@selectdb.com> Co-authored-by: lihangyu <lihangyu@selectdb.com>

mrhhsg force-pushed the opt_map_read branch from a3721e7 to 73f8294Compare December 17, 2025 09:00

[opt](olap) Optimize reading by rowids of Map Column
2ea18e5

mrhhsg force-pushed the opt_map_read branch from 73f8294 to 2ea18e5Compare December 17, 2025 13:01

eldenmoon approved these changes Dec 18, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Dec 18, 2025

github-actionsBot added the reviewed label Dec 18, 2025

zhangstar333 approved these changes Dec 18, 2025
View reviewed changes

mrhhsg merged commit 80d73c8 into apache:masterDec 18, 2025
26 of 28 checks passed

eldenmoon added the dev/4.0.x label Dec 18, 2025

kaka11chen mentioned this pull request Dec 23, 2025
[feature](reader) Optimize Complex Type Column Reading with Column Purning #59286
Merged
16 tasks

yiguolei added dev/4.0.3-merged and removed dev/4.0.x labels Dec 24, 2025

Uh oh!

Conversation

mrhhsg commented Dec 15, 2025

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Dec 15, 2025

Uh oh!

mrhhsg commented Dec 15, 2025

Uh oh!

doris-robot commented Dec 15, 2025

Uh oh!

doris-robot commented Dec 15, 2025

Uh oh!

doris-robot commented Dec 15, 2025

Uh oh!

doris-robot commented Dec 15, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Dec 15, 2025

BE Regression && UT Coverage Report

Uh oh!

mrhhsg commented Dec 16, 2025

Uh oh!

doris-robot commented Dec 16, 2025

Uh oh!

doris-robot commented Dec 16, 2025

Uh oh!

doris-robot commented Dec 16, 2025

Uh oh!

hello-stephen commented Dec 16, 2025

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Dec 16, 2025

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Dec 16, 2025

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Dec 16, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Dec 16, 2025

BE Regression && UT Coverage Report

Uh oh!

mrhhsg commented Dec 17, 2025

Uh oh!

doris-robot commented Dec 17, 2025

Uh oh!

doris-robot commented Dec 17, 2025

Uh oh!

doris-robot commented Dec 17, 2025

Uh oh!

mrhhsg commented Dec 17, 2025

Uh oh!

doris-robot commented Dec 17, 2025

Uh oh!

doris-robot commented Dec 17, 2025

Uh oh!

doris-robot commented Dec 17, 2025

Uh oh!

hello-stephen commented Dec 17, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Dec 17, 2025

BE Regression && UT Coverage Report

Uh oh!

hello-stephen commented Dec 17, 2025

BE Regression && UT Coverage Report

Uh oh!

eldenmoon left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Dec 18, 2025

Uh oh!

github-actionsBot commented Dec 18, 2025

Uh oh!

Uh oh!