Skip to content

[chore](test) add some tests for prune nested column - #58354

Merged
924060929 merged 1 commit into
apache:masterfrom
924060929:add-test
Nov 26, 2025
Merged

[chore](test) add some tests for prune nested column#58354
924060929 merged 1 commit into
apache:masterfrom
924060929:add-test

Conversation

@924060929

@924060929924060929 commented Nov 25, 2025•
edited
Loading

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

add some tests for prune nested column， #57204 related

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen

hello-stephen commented Nov 25, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@924060929

924060929 commented Nov 25, 2025

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Nov 25, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34461 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4da95c6b65f623d841a65a60373239907ef47528, data reload: false
------ Round 1 ----------------------------------
q1	17621	5081	4892	4892
q2	2080	302	206	206
q3	10249	1271	710	710
q4	10242	952	366	366
q5	7510	2383	2329	2329
q6	180	165	133	133
q7	914	772	635	635
q8	9334	1330	1114	1114
q9	6995	5274	5265	5265
q10	6862	2235	1820	1820
q11	489	306	277	277
q12	340	363	222	222
q13	17846	3642	3047	3047
q14	242	257	229	229
q15	596	530	509	509
q16	1073	1019	983	983
q17	607	861	398	398
q18	7544	7209	7149	7149
q19	1470	965	569	569
q20	358	353	242	242
q21	4128	3445	2355	2355
q22	1071	1036	1011	1011
Total cold run time: 107751 ms
Total hot run time: 34461 ms
----- Round 2, with runtime_filter_mode=off -----
q1	4996	4940	4973	4940
q2	343	376	324	324
q3	2280	2767	2303	2303
q4	1372	1765	1334	1334
q5	4245	4528	4566	4528
q6	233	183	137	137
q7	2041	1988	1838	1838
q8	2680	2638	2608	2608
q9	7502	7534	7411	7411
q10	3034	3237	2847	2847
q11	605	533	495	495
q12	661	767	660	660
q13	3649	3887	3331	3331
q14	297	340	277	277
q15	559	527	547	527
q16	1074	1098	1074	1074
q17	1155	1562	1408	1408
q18	7832	7861	7750	7750
q19	798	790	837	790
q20	2291	2051	1909	1909
q21	4846	4245	4278	4245
q22	1096	1037	1014	1014
Total cold run time: 53589 ms
Total hot run time: 51750 ms

@doris-robot

doris-robot commented Nov 25, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 184529 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4da95c6b65f623d841a65a60373239907ef47528, data reload: false
query1	1045	417	404	404
query2	6594	1572	1584	1572
query3	6757	232	225	225
query4	26359	22531	22379	22379
query5	4452	639	475	475
query6	361	239	232	232
query7	4683	499	309	309
query8	318	272	262	262
query9	8704	2583	2590	2583
query10	564	365	314	314
query11	15375	14793	14529	14529
query12	179	119	113	113
query13	1685	576	469	469
query14	10987	8933	9031	8933
query15	220	203	187	187
query16	7363	690	484	484
query17	1255	776	661	661
query18	2023	442	364	364
query19	223	202	184	184
query20	132	125	123	123
query21	221	140	124	124
query22	3801	4171	3955	3955
query23	33279	32625	32323	32323
query24	8499	2420	2419	2419
query25	634	555	476	476
query26	1248	311	159	159
query27	2706	497	352	352
query28	4368	2125	2113	2113
query29	814	603	487	487
query30	308	244	212	212
query31	850	709	629	629
query32	78	73	71	71
query33	618	374	332	332
query34	800	866	531	531
query35	791	850	750	750
query36	946	958	866	866
query37	123	113	90	90
query38	3379	3360	3259	3259
query39	1492	1444	1427	1427
query40	223	129	118	118
query41	66	64	64	64
query42	130	112	108	108
query43	454	451	430	430
query44	1232	753	757	753
query45	196	191	183	183
query46	884	1004	651	651
query47	1722	1751	1733	1733
query48	388	417	319	319
query49	799	489	412	412
query50	651	666	407	407
query51	3885	3893	3870	3870
query52	107	109	102	102
query53	282	263	196	196
query54	308	293	284	284
query55	88	89	84	84
query56	345	315	320	315
query57	1192	1194	1123	1123
query58	287	281	261	261
query59	2445	2487	2406	2406
query60	345	353	346	346
query61	168	166	157	157
query62	779	710	659	659
query63	222	191	190	190
query64	4490	1223	920	920
query65	4089	3987	3939	3939
query66	1155	421	333	333
query67	15208	15222	14824	14824
query68	8435	903	622	622
query69	505	336	302	302
query70	1297	1198	1313	1198
query71	475	331	298	298
query72	6077	4921	4866	4866
query73	719	604	375	375
query74	8560	8850	8425	8425
query75	3937	3347	2863	2863
query76	3760	1132	716	716
query77	814	375	304	304
query78	9634	9849	9058	9058
query79	2003	797	608	608
query80	636	583	487	487
query81	510	270	237	237
query82	487	160	136	136
query83	275	262	235	235
query84	249	118	96	96
query85	995	514	442	442
query86	395	301	288	288
query87	3470	3481	3461	3461
query88	3501	2235	2285	2235
query89	396	326	293	293
query90	1928	228	216	216
query91	174	169	139	139
query92	88	67	61	61
query93	1651	974	656	656
query94	712	461	347	347
query95	502	398	399	398
query96	502	562	281	281
query97	2952	2962	2838	2838
query98	250	216	210	210
query99	1365	1358	1274	1274
Total cold run time: 273628 ms
Total hot run time: 184529 ms

@doris-robot

doris-robot commented Nov 25, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 27.89 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4da95c6b65f623d841a65a60373239907ef47528, data reload: false
query1	0.05	0.04	0.04
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.63	0.12	0.11
query5	0.26	0.26	0.27
query6	1.19	0.66	0.64
query7	0.04	0.03	0.03
query8	0.05	0.04	0.05
query9	0.59	0.52	0.53
query10	0.56	0.57	0.56
query11	0.16	0.11	0.11
query12	0.14	0.12	0.12
query13	0.62	0.60	0.61
query14	1.00	0.99	1.03
query15	0.86	0.83	0.84
query16	0.40	0.40	0.39
query17	1.02	1.04	1.01
query18	0.21	0.19	0.20
query19	1.86	1.81	1.83
query20	0.02	0.01	0.02
query21	15.44	0.18	0.15
query22	5.12	0.07	0.05
query23	15.70	0.27	0.11
query24	2.68	0.99	0.80
query25	0.08	0.07	0.06
query26	0.15	0.14	0.12
query27	0.06	0.06	0.05
query28	4.98	1.15	0.92
query29	12.56	3.96	3.26
query30	0.29	0.15	0.12
query31	2.81	0.59	0.40
query32	3.23	0.55	0.48
query33	3.06	3.03	3.13
query34	15.67	5.15	4.58
query35	4.54	4.52	4.61
query36	0.69	0.50	0.49
query37	0.10	0.07	0.07
query38	0.07	0.04	0.04
query39	0.03	0.04	0.03
query40	0.18	0.15	0.13
query41	0.09	0.04	0.03
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 98.61 s
Total hot run time: 27.89 s

@hello-stephen

hello-stephen commented Nov 25, 2025

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 66.10% (39/59) 🎉
Increment coverage report
Complete coverage report

@hello-stephen

hello-stephen commented Nov 25, 2025

Copy link
Copy Markdown
Contributor

FE Regression Coverage Report

Increment line coverage 52.54% (31/59) 🎉
Increment coverage report
Complete coverage report

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Nov 26, 2025
@github-actions

github-actionsBot commented Nov 26, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actionsBot commented Nov 26, 2025

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@924060929
924060929 merged commit 70f3e9d into apache:masterNov 26, 2025
28 of 29 checks passed
@924060929
924060929 deleted the add-test branch November 26, 2025 02:35
nagisa-kunhah pushed a commit to nagisa-kunhah/doris that referenced this pull request Dec 14, 2025
@924060929@nagisa-kunhah
[chore](test) add some tests for prune nested column (apache#58354)
64b51a2
add some tests for prune nested column
924060929 added a commit that referenced this pull request Dec 23, 2025
@924060929
[chore](test) add some tests for prune nested column (#58354)
109bcca
add some tests for prune nested column
(cherry picked from commit 70f3e9d)
@kaka11chenkaka11chen mentioned this pull request Dec 23, 2025
Merged
16 tasks
yiguolei pushed a commit that referenced this pull request Dec 24, 2025
@kaka11chen@924060929
@mrhhsg@eldenmoon
[feature](reader) Optimize Complex Type Column Reading with Column Pu…
eea2586
…rning (#59286)
### What problem does this PR solve?
Problem Summary:
### Release note
Cherry-pick #58370#58354#59043#58851#58485#58682#58614#58373#57204#58719#58471#58573#58657
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [ ] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
---------
Co-authored-by: 924060929 <lanhuajian@selectdb.com>
Co-authored-by: Jerry Hu <mrhhsg@gmail.com>
Co-authored-by: Jerry Hu <hushenggang@selectdb.com>
Co-authored-by: lihangyu <lihangyu@selectdb.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@starocean999starocean999starocean999 approved these changes
@morrySnowmorrySnowmorrySnow approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/4.0.3-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@924060929@hello-stephen@doris-robot@starocean999@morrySnow@yiguolei