[refactor](scan) Remove colname_to_value_range from OlapTableScan by Gabriel39 · Pull Request #58290 · apache/doris

Gabriel39 · 2025-11-24T07:24:48Z

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-11-24T07:24:53Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

Gabriel39 · 2025-11-24T07:26:45Z

run buildall

doris-robot · 2025-11-24T08:08:03Z

TPC-H: Total hot run time: 34951 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit eb27550588851a98903688e66deeebe9a8068826, data reload: false
------ Round 1 ----------------------------------
q1	17613	5041	4955	4955
q2	1997	316	205	205
q3	10276	1302	730	730
q4	10232	863	363	363
q5	7523	2473	2286	2286
q6	193	173	141	141
q7	976	774	639	639
q8	9377	1333	991	991
q9	7172	5360	5371	5360
q10	6856	2243	1795	1795
q11	493	303	292	292
q12	346	365	235	235
q13	17770	3683	3070	3070
q14	233	243	212	212
q15	583	524	498	498
q16	1030	998	931	931
q17	600	880	352	352
q18	7555	7549	7730	7549
q19	1306	985	559	559
q20	366	365	252	252
q21	4049	3465	2519	2519
q22	1102	1072	1017	1017
Total cold run time: 107648 ms
Total hot run time: 34951 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5217	5119	5214	5119
q2	336	425	334	334
q3	2403	2868	2456	2456
q4	1430	1910	1428	1428
q5	4615	4428	4411	4411
q6	205	167	125	125
q7	1959	1974	1857	1857
q8	2633	2686	2522	2522
q9	7623	7535	7102	7102
q10	2897	3106	2655	2655
q11	560	510	493	493
q12	644	705	613	613
q13	3277	3641	3018	3018
q14	278	287	254	254
q15	547	508	491	491
q16	1002	1049	1001	1001
q17	1087	1425	1323	1323
q18	7322	7044	6932	6932
q19	753	738	780	738
q20	1926	1988	1802	1802
q21	4742	4340	4231	4231
q22	1110	1051	1004	1004
Total cold run time: 52566 ms
Total hot run time: 49909 ms

doris-robot · 2025-11-24T08:19:37Z

TPC-DS: Total hot run time: 187589 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit eb27550588851a98903688e66deeebe9a8068826, data reload: false
query1	1032	437	400	400
query2	6545	1683	1672	1672
query3	6756	221	219	219
query4	26136	23062	22844	22844
query5	4352	633	470	470
query6	317	227	251	227
query7	4644	486	293	293
query8	315	254	240	240
query9	8719	2607	2612	2607
query10	508	335	298	298
query11	15787	15109	14793	14793
query12	183	122	116	116
query13	1730	592	460	460
query14	10958	9198	9337	9198
query15	205	197	178	178
query16	7556	692	603	603
query17	1214	737	589	589
query18	1991	411	321	321
query19	212	199	176	176
query20	129	122	120	120
query21	211	137	116	116
query22	3950	4175	4078	4078
query23	33939	32919	33199	32919
query24	8503	2384	2388	2384
query25	602	505	453	453
query26	1223	264	165	165
query27	2764	484	349	349
query28	4363	2201	2198	2198
query29	806	623	500	500
query30	295	233	194	194
query31	916	765	722	722
query32	83	82	76	76
query33	586	374	353	353
query34	800	861	531	531
query35	828	846	737	737
query36	951	1001	917	917
query37	120	105	89	89
query38	3518	3585	3515	3515
query39	1471	1416	1418	1416
query40	217	127	120	120
query41	64	63	67	63
query42	123	111	108	108
query43	452	495	477	477
query44	1250	772	758	758
query45	186	181	168	168
query46	889	986	630	630
query47	1736	1752	1706	1706
query48	407	426	335	335
query49	782	503	415	415
query50	641	676	405	405
query51	3925	3868	3846	3846
query52	108	111	100	100
query53	241	259	199	199
query54	293	286	271	271
query55	96	91	97	91
query56	332	310	337	310
query57	1172	1192	1096	1096
query58	289	278	265	265
query59	2488	2702	2532	2532
query60	343	334	333	333
query61	171	167	168	167
query62	767	712	662	662
query63	231	193	198	193
query64	4518	1165	887	887
query65	4078	3925	3913	3913
query66	1135	439	344	344
query67	15285	15134	14862	14862
query68	4683	915	655	655
query69	504	337	294	294
query70	1365	1305	1245	1245
query71	422	328	308	308
query72	6064	5091	5089	5089
query73	636	561	343	343
query74	9086	8975	8947	8947
query75	3286	3331	2798	2798
query76	3310	1145	736	736
query77	534	394	323	323
query78	9575	9790	8978	8978
query79	2089	803	578	578
query80	1472	600	474	474
query81	562	257	223	223
query82	420	164	136	136
query83	273	261	253	253
query84	258	109	99	99
query85	908	521	432	432
query86	441	314	278	278
query87	3727	3707	3617	3617
query88	2845	2288	2280	2280
query89	382	321	294	294
query90	1657	228	230	228
query91	177	169	134	134
query92	78	67	64	64
query93	1377	1028	685	685
query94	723	456	348	348
query95	417	330	313	313
query96	493	569	290	290
query97	2892	2953	2843	2843
query98	233	207	208	207
query99	1282	1408	1305	1305
Total cold run time: 269608 ms
Total hot run time: 187589 ms

doris-robot · 2025-11-24T08:24:43Z

ClickBench: Total hot run time: 27.7 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit eb27550588851a98903688e66deeebe9a8068826, data reload: false
query1	0.05	0.06	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.61	0.11	0.11
query5	0.27	0.26	0.25
query6	1.19	0.64	0.63
query7	0.03	0.02	0.03
query8	0.05	0.04	0.04
query9	0.58	0.51	0.52
query10	0.58	0.57	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.65	0.61	0.61
query14	0.99	1.00	1.01
query15	0.83	0.83	0.85
query16	0.38	0.39	0.40
query17	1.03	1.02	1.01
query18	0.22	0.20	0.20
query19	1.88	1.79	1.80
query20	0.01	0.02	0.01
query21	15.48	0.17	0.12
query22	5.16	0.07	0.05
query23	15.66	0.26	0.11
query24	2.88	0.72	0.67
query25	0.06	0.07	0.06
query26	0.14	0.14	0.13
query27	0.07	0.05	0.05
query28	4.55	1.15	0.94
query29	12.63	3.85	3.25
query30	0.28	0.13	0.11
query31	2.82	0.59	0.39
query32	3.23	0.55	0.48
query33	3.08	3.02	3.14
query34	15.72	5.20	4.51
query35	4.57	4.62	4.59
query36	0.68	0.50	0.49
query37	0.10	0.06	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.15
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.57 s
Total hot run time: 27.7 s

doris-robot · 2025-11-24T08:44:10Z

BE UT Coverage Report

Increment line coverage 25.00% (4/16) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.63% (18278/34729)
Line Coverage	38.06% (166309/436931)
Region Coverage	33.04% (129394/391597)
Branch Coverage	33.81% (55479/164088)

hello-stephen · 2025-11-24T09:55:52Z

BE Regression && UT Coverage Report

Increment line coverage 87.50% (14/16) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.55% (24391/34088)
Line Coverage	58.02% (253629/437104)
Region Coverage	53.38% (211884/396914)
Branch Coverage	54.67% (90256/165099)

Gabriel39 · 2025-11-25T07:35:57Z

run buildall

doris-robot · 2025-11-25T08:47:35Z

TPC-H: Total hot run time: 34688 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 87fdf843188c626e67e7a34fdfb532731bbf7964, data reload: false
------ Round 1 ----------------------------------
q1	17610	5144	4987	4987
q2	2008	329	213	213
q3	10242	1324	736	736
q4	10227	923	387	387
q5	7499	2439	2345	2345
q6	191	175	142	142
q7	949	798	668	668
q8	9378	1388	1188	1188
q9	7182	5471	5363	5363
q10	6933	2251	1810	1810
q11	499	296	301	296
q12	376	374	220	220
q13	17775	3700	3017	3017
q14	232	236	219	219
q15	577	517	507	507
q16	1012	999	967	967
q17	604	880	368	368
q18	7696	7158	7123	7123
q19	1106	983	571	571
q20	362	342	235	235
q21	3918	3218	2353	2353
q22	1036	1010	973	973
Total cold run time: 107412 ms
Total hot run time: 34688 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5028	4991	4975	4975
q2	332	395	327	327
q3	2175	2763	2315	2315
q4	1368	1797	1348	1348
q5	4333	4622	4651	4622
q6	229	186	131	131
q7	2122	1999	1845	1845
q8	2791	2694	2505	2505
q9	7566	7648	7578	7578
q10	3132	3260	2941	2941
q11	609	506	499	499
q12	684	798	646	646
q13	3585	3941	3285	3285
q14	311	322	289	289
q15	573	522	516	516
q16	1078	1118	1075	1075
q17	1186	1570	1461	1461
q18	7934	7639	7727	7639
q19	839	915	1068	915
q20	2059	2047	1954	1954
q21	4959	4378	4351	4351
q22	1096	1037	1019	1019
Total cold run time: 53989 ms
Total hot run time: 52236 ms

doris-robot · 2025-11-25T08:59:05Z

TPC-DS: Total hot run time: 184113 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 87fdf843188c626e67e7a34fdfb532731bbf7964, data reload: false
query1	1047	440	396	396
query2	6565	1593	1617	1593
query3	6760	223	233	223
query4	26146	22749	22267	22267
query5	4416	603	463	463
query6	313	227	222	222
query7	4641	500	306	306
query8	296	245	247	245
query9	8727	2583	2599	2583
query10	512	358	306	306
query11	15603	14760	14642	14642
query12	184	117	111	111
query13	1689	566	449	449
query14	10618	8862	8859	8859
query15	217	208	183	183
query16	7361	717	535	535
query17	1290	744	628	628
query18	2011	415	313	313
query19	211	199	173	173
query20	123	123	118	118
query21	215	133	110	110
query22	3859	3965	3888	3888
query23	32960	32241	32211	32211
query24	8433	2372	2364	2364
query25	588	510	447	447
query26	1248	267	171	171
query27	2759	485	340	340
query28	4356	2180	2116	2116
query29	834	612	490	490
query30	317	238	209	209
query31	837	721	619	619
query32	88	73	74	73
query33	592	379	334	334
query34	813	901	547	547
query35	798	849	743	743
query36	910	966	871	871
query37	130	111	87	87
query38	3336	3330	3262	3262
query39	1494	1390	1398	1390
query40	221	124	119	119
query41	66	63	63	63
query42	124	113	116	113
query43	451	467	434	434
query44	1221	740	756	740
query45	200	193	183	183
query46	884	999	636	636
query47	1691	1734	1661	1661
query48	398	429	333	333
query49	766	496	431	431
query50	650	673	404	404
query51	3934	3919	3871	3871
query52	114	112	103	103
query53	244	264	191	191
query54	308	290	274	274
query55	99	94	90	90
query56	349	328	326	326
query57	1129	1198	1104	1104
query58	289	275	279	275
query59	2372	2543	2385	2385
query60	350	359	343	343
query61	164	158	182	158
query62	768	715	674	674
query63	234	194	199	194
query64	4694	1291	998	998
query65	4043	3984	3988	3984
query66	1162	453	351	351
query67	15214	14854	14917	14854
query68	8205	955	632	632
query69	523	350	311	311
query70	1349	1283	1168	1168
query71	448	336	308	308
query72	6012	4933	4915	4915
query73	615	590	350	350
query74	8564	8742	8679	8679
query75	3500	3347	2811	2811
query76	3448	1119	689	689
query77	752	419	307	307
query78	9499	9699	8818	8818
query79	2283	839	581	581
query80	625	576	488	488
query81	511	275	241	241
query82	454	160	128	128
query83	278	264	247	247
query84	260	113	103	103
query85	916	479	466	466
query86	385	305	279	279
query87	3484	3537	3432	3432
query88	3671	2263	2263	2263
query89	389	326	290	290
query90	1919	215	214	214
query91	171	181	143	143
query92	81	68	69	68
query93	1856	975	654	654
query94	758	452	347	347
query95	495	407	391	391
query96	504	568	281	281
query97	2919	3012	2853	2853
query98	247	214	212	212
query99	1704	1394	1265	1265
Total cold run time: 272261 ms
Total hot run time: 184113 ms

doris-robot · 2025-11-25T09:04:12Z

ClickBench: Total hot run time: 27.88 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 87fdf843188c626e67e7a34fdfb532731bbf7964, data reload: false
query1	0.05	0.05	0.06
query2	0.09	0.05	0.06
query3	0.26	0.08	0.08
query4	1.60	0.11	0.11
query5	0.27	0.25	0.25
query6	1.19	0.63	0.67
query7	0.04	0.02	0.02
query8	0.05	0.04	0.04
query9	0.57	0.52	0.53
query10	0.58	0.57	0.60
query11	0.17	0.11	0.11
query12	0.16	0.12	0.11
query13	0.64	0.61	0.61
query14	1.00	1.00	1.00
query15	0.84	0.83	0.83
query16	0.39	0.40	0.40
query17	0.99	1.00	1.04
query18	0.22	0.20	0.20
query19	1.87	1.82	1.81
query20	0.02	0.02	0.02
query21	15.50	0.20	0.13
query22	4.84	0.08	0.04
query23	15.67	0.26	0.11
query24	2.84	0.75	0.85
query25	0.09	0.06	0.05
query26	0.14	0.13	0.13
query27	0.07	0.06	0.05
query28	4.97	1.14	0.95
query29	12.56	3.93	3.34
query30	0.28	0.13	0.11
query31	2.82	0.59	0.39
query32	3.22	0.55	0.47
query33	3.07	3.05	3.05
query34	15.89	5.18	4.51
query35	4.55	4.61	4.55
query36	0.68	0.50	0.49
query37	0.10	0.08	0.07
query38	0.06	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.02
Total cold run time: 98.71 s
Total hot run time: 27.88 s

github-actions · 2025-11-25T11:56:46Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-11-25T11:56:49Z

PR approved by anyone and no changes requested.

hello-stephen · 2025-11-26T03:54:53Z

BE UT Coverage Report

Increment line coverage 0.00% (0/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.90% (18416/34816)
Line Coverage	38.38% (168303/438564)
Region Coverage	33.18% (130693/393839)
Branch Coverage	34.10% (56216/164847)

hello-stephen · 2025-11-26T03:59:45Z

BE Regression && UT Coverage Report

Increment line coverage 85.71% (12/14) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	71.30% (24371/34180)
Line Coverage	57.79% (253610/438862)
Region Coverage	53.01% (211658/399303)
Branch Coverage	54.46% (90378/165944)

…ache#58290)

### What problem does this PR solve? pick #57397 #58283 #58290 #58282 #58832 #58905 #58960 #59005 #59088 #59098 #59126 #59187 #59581 #59625 #59775 ### Check List (For Author) - Test  - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason  - Behavior changed: - [ ] No. - [ ] Yes.  - Does this need documentation? - [ ] No. - [ ] Yes.  ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label

### What problem does this PR solve? pick apache#57397 apache#58283 apache#58290 apache#58282 apache#58832 apache#58905 apache#58960 apache#59005 apache#59088 apache#59098 apache#59126 apache#59187 apache#59581 apache#59625 apache#59775 ### Check List (For Author) - Test  - [ ] Regression test - [ ] Unit Test - [ ] Manual test (add detailed scripts or steps below) - [ ] No need to test or manual test. Explain why: - [ ] This is a refactor/code format and no logic has been changed. - [ ] Previous test can cover this change. - [ ] No code files have been changed. - [ ] Other reason  - Behavior changed: - [ ] No. - [ ] Yes.  - Does this need documentation? - [ ] No. - [ ] Yes.  ### Check List (For Reviewer who merge this PR) - [ ] Confirm the release note - [ ] Confirm test cases - [ ] Confirm document - [ ] Add branch pick label

[refactor](scan) Remove colname_to_value_range from OlapTableScan
990223d

update
eb27550

Gabriel39 added 2 commits November 25, 2025 15:26

update
17887cf

update
87fdf84

zhangstar333 approved these changes Nov 25, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Nov 25, 2025

github-actionsBot added the reviewed label Nov 25, 2025

Mryange approved these changes Nov 26, 2025
View reviewed changes

Gabriel39 merged commit 4a6e6cf into apache:masterNov 26, 2025
26 of 28 checks passed

nagisa-kunhah pushed a commit to nagisa-kunhah/doris that referenced this pull request Dec 14, 2025
[refactor](scan) Remove colname_to_value_range from OlapTableScan (ap…
78fdc26
…ache#58290)

Gabriel39 added a commit to Gabriel39/incubator-doris that referenced this pull request Jan 13, 2026
[refactor](scan) Remove colname_to_value_range from OlapTableScan (ap…
f2e0346
…ache#58290)

Gabriel39 mentioned this pull request Jan 13, 2026
[branch-4.0]Pick predicates-related PR #59804
Merged
16 tasks

yiguolei added the dev/4.0.3-merged label Jan 14, 2026

Gabriel39 deleted the refactor_1124_1 branch July 30, 2026 06:28

Uh oh!

Conversation

Gabriel39 commented Nov 24, 2025

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Nov 24, 2025

Uh oh!

Gabriel39 commented Nov 24, 2025

Uh oh!

doris-robot commented Nov 24, 2025

Uh oh!

doris-robot commented Nov 24, 2025

Uh oh!

doris-robot commented Nov 24, 2025

Uh oh!

doris-robot commented Nov 24, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 24, 2025

BE Regression && UT Coverage Report

Uh oh!

Gabriel39 commented Nov 25, 2025

Uh oh!

doris-robot commented Nov 25, 2025

Uh oh!

doris-robot commented Nov 25, 2025

Uh oh!

doris-robot commented Nov 25, 2025

Uh oh!

github-actionsBot commented Nov 25, 2025

Uh oh!

github-actionsBot commented Nov 25, 2025

Uh oh!

hello-stephen commented Nov 26, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Nov 26, 2025

BE Regression && UT Coverage Report

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants