[test](mv) Fix regression test out text is wrong by seawinde · Pull Request #43095 · apache/doris

seawinde · 2024-11-01T11:56:51Z

What problem does this PR solve?

When shrinking the test data set, the corresponding out file data was not refreshed. As a result, the data in the out file was refreshed again.

There are some tests that hit both materialized views as expected, modifying such corresponding cases.

Issue Number: close #xxx

Related PR:
#40860
#41644

Problem Summary:

Check List (For Committer)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No colde files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.
Release note
None

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

doris-robot · 2024-11-01T11:56:55Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

seawinde · 2024-11-01T11:59:31Z

run buildall

github-actions · 2024-11-01T12:06:19Z

PR approved by at least one committer and no changes requested.

github-actions · 2024-11-01T12:06:22Z

PR approved by anyone and no changes requested.

zfr9527

LGTM

seawinde · 2024-11-04T11:40:08Z

run buildall

seawinde · 2024-11-05T06:24:56Z

run buildall

doris-robot · 2024-11-05T07:02:37Z

TPC-H: Total hot run time: 41379 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 83f4ea803a62fc1a85107bca72e0d37d0eb02285, data reload: false
------ Round 1 ----------------------------------
q1	17580	7433	7306	7306
q2	2073	163	160	160
q3	10841	1101	1132	1101
q4	10527	867	913	867
q5	7753	3099	3089	3089
q6	241	150	147	147
q7	1018	621	607	607
q8	9351	1953	2017	1953
q9	6555	6414	6471	6414
q10	7107	2420	2419	2419
q11	477	258	263	258
q12	411	221	217	217
q13	17794	2997	2988	2988
q14	228	207	209	207
q15	576	528	517	517
q16	664	595	598	595
q17	986	556	529	529
q18	7305	6774	6721	6721
q19	1333	958	919	919
q20	490	179	184	179
q21	3998	3195	3222	3195
q22	1115	991	992	991
Total cold run time: 108423 ms
Total hot run time: 41379 ms
----- Round 2, with runtime_filter_mode=off -----
q1	7278	7256	7278	7256
q2	326	225	234	225
q3	2978	2947	2961	2947
q4	2110	1885	1821	1821
q5	5754	5713	5797	5713
q6	235	139	144	139
q7	2205	1870	1803	1803
q8	3400	3524	3428	3428
q9	8946	8905	8888	8888
q10	3597	3572	3587	3572
q11	605	507	496	496
q12	845	635	606	606
q13	10364	3221	3237	3221
q14	307	270	272	270
q15	578	529	526	526
q16	688	652	637	637
q17	1872	1627	1650	1627
q18	8299	7694	7692	7692
q19	1732	1508	1643	1508
q20	2152	1863	1968	1863
q21	5612	5433	5342	5342
q22	1152	1076	1053	1053
Total cold run time: 71035 ms
Total hot run time: 60633 ms

doris-robot · 2024-11-05T07:15:11Z

TPC-DS: Total hot run time: 195782 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 83f4ea803a62fc1a85107bca72e0d37d0eb02285, data reload: false
query1	1199	897	950	897
query2	6210	2081	2042	2042
query3	10809	4086	3887	3887
query4	66993	29524	23659	23659
query5	4914	445	431	431
query6	398	196	171	171
query7	5555	294	290	290
query8	311	228	220	220
query9	9030	2644	2648	2644
query10	462	251	246	246
query11	17271	15364	16028	15364
query12	153	99	98	98
query13	1525	433	429	429
query14	10378	7292	6836	6836
query15	219	192	193	192
query16	7081	442	477	442
query17	1005	563	563	563
query18	1813	300	293	293
query19	199	149	154	149
query20	117	109	110	109
query21	200	99	100	99
query22	4528	4461	4408	4408
query23	35250	34114	34029	34029
query24	6025	2741	2739	2739
query25	500	387	403	387
query26	645	158	156	156
query27	1675	296	289	289
query28	4067	2436	2414	2414
query29	692	423	424	423
query30	233	148	163	148
query31	969	799	807	799
query32	63	64	56	56
query33	419	269	266	266
query34	918	505	518	505
query35	830	737	731	731
query36	1080	964	972	964
query37	124	76	72	72
query38	4369	4258	4332	4258
query39	1491	1456	1405	1405
query40	207	103	102	102
query41	47	47	45	45
query42	109	97	102	97
query43	535	500	495	495
query44	1151	824	831	824
query45	186	166	165	165
query46	1120	697	699	697
query47	1941	1839	1849	1839
query48	407	323	321	321
query49	725	415	408	408
query50	793	397	408	397
query51	7244	7224	7048	7048
query52	103	83	83	83
query53	249	174	181	174
query54	518	408	388	388
query55	78	75	72	72
query56	248	242	238	238
query57	1294	1203	1160	1160
query58	213	199	212	199
query59	3188	2989	3053	2989
query60	279	238	246	238
query61	107	105	108	105
query62	797	676	662	662
query63	209	183	186	183
query64	1346	645	640	640
query65	3240	3201	3237	3201
query66	703	310	304	304
query67	16092	15654	15810	15654
query68	3970	583	573	573
query69	403	247	248	247
query70	1156	1133	1129	1129
query71	355	263	243	243
query72	6087	4045	3959	3959
query73	752	361	355	355
query74	10133	9040	9018	9018
query75	3604	2654	2718	2654
query76	1800	1107	1024	1024
query77	507	294	268	268
query78	10402	9358	9360	9358
query79	1492	584	588	584
query80	882	423	419	419
query81	504	242	239	239
query82	1261	110	119	110
query83	222	139	135	135
query84	283	70	68	68
query85	902	299	295	295
query86	345	299	301	299
query87	4911	4687	4645	4645
query88	3589	2204	2180	2180
query89	410	294	290	290
query90	1991	195	182	182
query91	140	109	103	103
query92	61	47	50	47
query93	1937	549	557	549
query94	813	293	292	292
query95	343	241	245	241
query96	610	278	283	278
query97	2945	2654	2662	2654
query98	208	211	199	199
query99	1601	1309	1307	1307
Total cold run time: 317468 ms
Total hot run time: 195782 ms

doris-robot · 2024-11-05T07:20:41Z

ClickBench: Total hot run time: 31.77 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 83f4ea803a62fc1a85107bca72e0d37d0eb02285, data reload: false
query1	0.03	0.03	0.02
query2	0.07	0.03	0.03
query3	0.23	0.06	0.07
query4	1.63	0.10	0.10
query5	0.41	0.39	0.41
query6	1.15	0.65	0.65
query7	0.02	0.02	0.02
query8	0.03	0.03	0.02
query9	0.56	0.49	0.49
query10	0.56	0.55	0.54
query11	0.15	0.10	0.11
query12	0.14	0.11	0.12
query13	0.60	0.59	0.59
query14	2.75	2.75	2.76
query15	0.91	0.83	0.83
query16	0.37	0.40	0.41
query17	1.04	1.07	1.01
query18	0.20	0.20	0.20
query19	1.99	1.88	2.01
query20	0.01	0.00	0.01
query21	15.38	0.61	0.60
query22	2.35	2.43	1.52
query23	16.93	1.07	0.90
query24	2.45	0.46	1.68
query25	0.15	0.18	0.05
query26	0.50	0.14	0.15
query27	0.05	0.04	0.04
query28	10.99	1.08	1.06
query29	12.68	3.24	3.21
query30	0.25	0.07	0.06
query31	2.86	0.38	0.38
query32	3.29	0.45	0.45
query33	3.00	3.07	3.11
query34	16.85	4.42	4.44
query35	4.49	4.45	4.48
query36	0.67	0.47	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.2 s
Total hot run time: 31.77 s

seawinde · 2024-11-05T07:32:07Z

run buildall

seawinde · 2024-11-05T11:17:00Z

run buildall

morrySnow · 2024-11-06T09:40:37Z

run buildall

seawinde · 2024-11-06T12:09:09Z

run buildall

seawinde · 2024-11-06T12:20:53Z

run buildall

seawinde · 2024-11-07T08:53:20Z

run buildall

github-actions · 2024-11-15T11:34:44Z

PR approved by at least one committer and no changes requested.

When shrinking the test data set, the corresponding out file data was not refreshed. As a result, the data in the out file was refreshed again. There are some tests that hit both materialized views as expected, modifying such corresponding cases.

pick from master commit id 6fdc8a5 PR #41674 commit id 7c45912 PR #43095 commit id 7aec6ff PR #44164

### Problem Summary: When shrinking the test data set, the corresponding out file data was not refreshed. As a result, the data in the out file was refreshed again. There are some tests that hit both materialized views as expected, modifying such corresponding cases. ### Related PR: apache#40860 apache#41644

morrySnow previously approved these changes Nov 1, 2024
View reviewed changes

morrySnow added the dev/3.0.x label Nov 1, 2024

github-actionsBot added approved Indicates a PR has been approved by one committer. reviewed labels Nov 1, 2024

zfr9527 approved these changes Nov 4, 2024
View reviewed changes

seawinde dismissed morrySnow’s stale review via 895ed8bNovember 4, 2024 11:39

github-actionsBot removed the approved Indicates a PR has been approved by one committer. label Nov 4, 2024

seawindeand others added 7 commits November 6, 2024 19:18

[test](mv) Fix regression test out text is wrong
a84606a

make case stable
83dc14a

disable debug session when refresh
9f04756

disable debug session when refresh
352a7f0

fix test not stable
0795356

fix create table like not stable
3f3623d

fix create table like not stable
2dcdb40

seawinde force-pushed the fix_-agg_sync_mv_regression_out_wrong branch from 02c39d0 to 2dcdb40Compare November 6, 2024 12:08

inject statistic
f8d0cea

fix table exist
8fc671a

morrySnow approved these changes Nov 15, 2024
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Nov 15, 2024

morrySnow merged commit 7c45912 into apache:masterNov 18, 2024

github-actionsBot added the cherry-pick-conflict-in-3.0 label Nov 18, 2024

seawinde mentioned this pull request Nov 19, 2024
Pick some pr to branch 3.0 #41674 #43095 #44164 #44290
Merged
16 tasks

morrySnow pushed a commit that referenced this pull request Nov 22, 2024
[pick](mtmv) Pick some pr to branch 3.0#41674#43095#44164(#44290)
eeda1ce
pick from master commit id 6fdc8a5 PR #41674 commit id 7c45912 PR #43095 commit id 7aec6ff PR #44164

morrySnow added dev/3.0.3-merged and removed dev/3.0.x cherry-pick-conflict-in-3.0 labels Nov 22, 2024

Uh oh!

Conversation

seawinde commented Nov 1, 2024

What problem does this PR solve?

Check List (For Committer)

Check List (For Reviewer who merge this PR)

Uh oh!

doris-robot commented Nov 1, 2024

Uh oh!

seawinde commented Nov 1, 2024

Uh oh!

github-actionsBot commented Nov 1, 2024

Uh oh!

github-actionsBot commented Nov 1, 2024

Uh oh!

zfr9527 left a comment

Choose a reason for hiding this comment

Uh oh!

seawinde commented Nov 4, 2024

Uh oh!

seawinde commented Nov 5, 2024

Uh oh!

doris-robot commented Nov 5, 2024

Uh oh!

doris-robot commented Nov 5, 2024

Uh oh!

doris-robot commented Nov 5, 2024

Uh oh!

seawinde commented Nov 5, 2024

Uh oh!

seawinde commented Nov 5, 2024

Uh oh!

morrySnow commented Nov 6, 2024

Uh oh!

seawinde commented Nov 6, 2024

Uh oh!

seawinde commented Nov 6, 2024

Uh oh!

seawinde commented Nov 7, 2024

Uh oh!

github-actionsBot commented Nov 15, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants