[fix](auto partition) Fix duplicate rows in auto-partitioned table by Gabriel39 · Pull Request #47911 · apache/doris

Gabriel39 · 2025-02-14T07:11:03Z

What problem does this PR solve?

The same block may be sent twice by TabletSinkHashPartitioner. To get the correct result, we should not send any rows the last time.

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

hello-stephen · 2025-02-14T07:11:25Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

Gabriel39 · 2025-02-14T07:12:41Z

run buildall

doris-robot · 2025-02-14T08:11:09Z

TPC-H: Total hot run time: 31482 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7f3f7a69d181a7bc9ebcb2e6941e5437ec8f9534, data reload: false
------ Round 1 ----------------------------------
q1	17608	5211	5061	5061
q2	2053	299	161	161
q3	10510	1280	723	723
q4	10218	993	522	522
q5	7524	2415	2286	2286
q6	187	169	133	133
q7	894	754	597	597
q8	9298	1277	1085	1085
q9	4789	4669	4712	4669
q10	6849	2309	1891	1891
q11	472	273	252	252
q12	338	349	211	211
q13	17769	3675	3097	3097
q14	239	233	204	204
q15	517	465	470	465
q16	633	615	561	561
q17	560	869	337	337
q18	6947	6250	6301	6250
q19	1503	954	542	542
q20	308	325	190	190
q21	2735	2098	1932	1932
q22	360	337	313	313
Total cold run time: 102311 ms
Total hot run time: 31482 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5093	5097	5083	5083
q2	231	331	229	229
q3	2174	2668	2283	2283
q4	1408	1834	1361	1361
q5	4212	4130	4131	4130
q6	207	163	126	126
q7	1827	1820	1658	1658
q8	2575	2578	2566	2566
q9	7209	7190	7146	7146
q10	3009	3200	2778	2778
q11	553	513	503	503
q12	667	807	589	589
q13	3518	3856	3339	3339
q14	299	290	271	271
q15	516	470	472	470
q16	639	675	653	653
q17	1117	1610	1326	1326
q18	7614	7495	7167	7167
q19	763	814	798	798
q20	1988	1989	1862	1862
q21	5388	4985	4812	4812
q22	649	574	555	555
Total cold run time: 51656 ms
Total hot run time: 49705 ms

doris-robot · 2025-02-14T08:23:12Z

TPC-DS: Total hot run time: 189602 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7f3f7a69d181a7bc9ebcb2e6941e5437ec8f9534, data reload: false
query1	1309	957	923	923
query2	6212	1797	1815	1797
query3	11088	4651	4663	4651
query4	54131	25392	23276	23276
query5	5173	552	488	488
query6	362	186	180	180
query7	5166	504	289	289
query8	318	246	229	229
query9	6532	2509	2511	2509
query10	433	313	263	263
query11	15273	15049	14865	14865
query12	149	106	106	106
query13	1183	511	368	368
query14	10981	6468	6349	6349
query15	191	197	188	188
query16	7059	668	505	505
query17	1080	753	580	580
query18	1520	423	325	325
query19	207	198	169	169
query20	123	164	119	119
query21	213	120	103	103
query22	4376	4474	4283	4283
query23	34093	33253	33320	33253
query24	5682	2379	2442	2379
query25	482	461	386	386
query26	736	272	159	159
query27	1787	510	330	330
query28	2777	2439	2413	2413
query29	603	559	421	421
query30	208	204	160	160
query31	886	844	798	798
query32	70	64	60	60
query33	425	348	298	298
query34	744	844	492	492
query35	808	825	730	730
query36	968	1022	923	923
query37	119	104	78	78
query38	4251	4261	4256	4256
query39	1467	1421	1429	1421
query40	206	119	99	99
query41	51	48	49	48
query42	114	106	100	100
query43	508	520	473	473
query44	1286	816	800	800
query45	180	190	175	175
query46	887	1085	672	672
query47	1802	1874	1817	1817
query48	401	411	310	310
query49	696	513	416	416
query50	716	745	415	415
query51	4186	4349	4208	4208
query52	107	109	100	100
query53	247	265	185	185
query54	482	493	424	424
query55	84	82	82	82
query56	269	264	269	264
query57	1180	1186	1127	1127
query58	246	244	238	238
query59	2657	2910	2794	2794
query60	294	270	277	270
query61	128	114	119	114
query62	765	735	701	701
query63	243	194	195	194
query64	1900	1033	669	669
query65	3344	3127	3109	3109
query66	779	389	296	296
query67	15723	15529	15555	15529
query68	5619	748	498	498
query69	540	291	262	262
query70	1233	1142	1112	1112
query71	445	287	264	264
query72	5969	3639	3781	3639
query73	1174	745	342	342
query74	8989	9207	8724	8724
query75	3172	3161	2683	2683
query76	4016	1162	727	727
query77	553	364	276	276
query78	9926	9947	9283	9283
query79	2474	825	587	587
query80	625	522	441	441
query81	501	275	240	240
query82	664	130	94	94
query83	178	172	161	161
query84	286	91	72	72
query85	777	347	306	306
query86	373	299	286	286
query87	4453	4534	4452	4452
query88	3487	2170	2158	2158
query89	418	314	275	275
query90	1723	260	188	188
query91	133	144	109	109
query92	76	59	56	56
query93	1919	996	575	575
query94	699	399	296	296
query95	338	264	247	247
query96	465	560	264	264
query97	2836	2899	2755	2755
query98	232	207	205	205
query99	1708	1397	1274	1274
Total cold run time: 294667 ms
Total hot run time: 189602 ms

doris-robot · 2025-02-14T08:28:31Z

ClickBench: Total hot run time: 30.37 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7f3f7a69d181a7bc9ebcb2e6941e5437ec8f9534, data reload: false
query1	0.04	0.04	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.42	0.41	0.39
query6	1.16	0.65	0.67
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.56	0.51	0.52
query10	0.58	0.58	0.58
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	2.67	2.69	2.71
query15	0.92	0.85	0.85
query16	0.37	0.37	0.39
query17	1.01	1.02	1.02
query18	0.21	0.19	0.20
query19	1.89	1.86	2.01
query20	0.02	0.02	0.01
query21	15.37	0.91	0.55
query22	0.76	1.27	0.66
query23	14.86	1.36	0.67
query24	11.90	1.02	0.51
query25	0.44	0.22	0.15
query26	0.89	0.19	0.14
query27	0.05	0.04	0.04
query28	6.21	0.74	0.42
query29	12.59	3.95	3.27
query30	0.25	0.08	0.06
query31	2.83	0.59	0.40
query32	3.23	0.54	0.47
query33	2.96	3.01	2.97
query34	15.74	5.12	4.53
query35	4.56	4.52	4.55
query36	0.65	0.49	0.47
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.5 s
Total hot run time: 30.37 s

zclllyybb

LGTM

github-actions · 2025-02-14T09:14:12Z

PR approved by anyone and no changes requested.

Gabriel39 · 2025-02-17T01:49:46Z

run buildall

github-actions · 2025-02-17T01:58:26Z

PR approved by at least one committer and no changes requested.

doris-robot · 2025-02-17T02:38:08Z

TPC-H: Total hot run time: 31534 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 252a78747cb3aa6c80f446a173b3dfc14b4d148b, data reload: false
------ Round 1 ----------------------------------
q1	17577	5193	5084	5084
q2	2046	310	169	169
q3	10410	1391	760	760
q4	10212	1010	539	539
q5	7502	2406	2295	2295
q6	188	165	130	130
q7	894	754	585	585
q8	9288	1276	1140	1140
q9	4833	4680	4651	4651
q10	6832	2305	1923	1923
q11	482	280	251	251
q12	349	353	224	224
q13	17793	3698	3059	3059
q14	223	220	208	208
q15	518	478	462	462
q16	633	618	565	565
q17	569	868	343	343
q18	6545	6306	6127	6127
q19	1217	957	572	572
q20	318	320	198	198
q21	2892	2098	1948	1948
q22	354	331	301	301
Total cold run time: 101675 ms
Total hot run time: 31534 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5137	5112	5131	5112
q2	242	328	238	238
q3	2188	2699	2312	2312
q4	1438	1811	1372	1372
q5	4251	4162	4147	4147
q6	216	167	124	124
q7	1883	1820	1661	1661
q8	2618	2607	2558	2558
q9	7185	7195	7076	7076
q10	3021	3246	2803	2803
q11	580	519	489	489
q12	703	781	631	631
q13	3459	3891	3345	3345
q14	295	288	289	288
q15	496	479	468	468
q16	620	693	654	654
q17	1147	1583	1360	1360
q18	7596	7410	7427	7410
q19	797	901	1027	901
q20	1948	2002	1911	1911
q21	5395	5077	4682	4682
q22	635	581	549	549
Total cold run time: 51850 ms
Total hot run time: 50091 ms

doris-robot · 2025-02-17T02:50:13Z

TPC-DS: Total hot run time: 190456 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 252a78747cb3aa6c80f446a173b3dfc14b4d148b, data reload: false
query1	1305	965	931	931
query2	6223	1831	1827	1827
query3	10972	4447	4442	4442
query4	54496	25245	23530	23530
query5	5140	540	476	476
query6	366	196	205	196
query7	5031	507	296	296
query8	323	249	247	247
query9	6199	2515	2523	2515
query10	452	304	257	257
query11	15241	15039	15215	15039
query12	162	110	114	110
query13	1136	513	374	374
query14	10659	6653	6420	6420
query15	205	206	177	177
query16	7089	651	465	465
query17	1070	735	601	601
query18	1531	424	328	328
query19	198	206	170	170
query20	135	131	127	127
query21	203	124	108	108
query22	4285	4444	4448	4444
query23	33943	33586	33450	33450
query24	5738	2460	2448	2448
query25	477	459	387	387
query26	745	269	162	162
query27	1907	487	346	346
query28	2821	2439	2406	2406
query29	629	558	422	422
query30	207	185	167	167
query31	899	883	815	815
query32	79	70	64	64
query33	478	344	304	304
query34	781	866	493	493
query35	806	861	757	757
query36	946	1019	908	908
query37	122	99	80	80
query38	4358	4326	4395	4326
query39	1491	1438	1463	1438
query40	205	116	105	105
query41	50	51	51	51
query42	125	108	115	108
query43	502	508	489	489
query44	1298	798	794	794
query45	188	174	164	164
query46	898	1077	664	664
query47	1831	1897	1791	1791
query48	410	418	326	326
query49	698	522	429	429
query50	729	749	424	424
query51	4308	4311	4228	4228
query52	106	113	96	96
query53	247	276	193	193
query54	482	496	421	421
query55	80	85	79	79
query56	269	261	288	261
query57	1158	1193	1103	1103
query58	252	249	241	241
query59	2600	2847	2572	2572
query60	278	274	257	257
query61	123	122	133	122
query62	711	735	687	687
query63	232	201	197	197
query64	2503	1031	705	705
query65	3277	3202	3139	3139
query66	818	393	312	312
query67	15665	15425	15349	15349
query68	5480	795	506	506
query69	516	297	262	262
query70	1203	1105	1107	1105
query71	452	295	331	295
query72	6320	3723	3926	3723
query73	1188	768	339	339
query74	8945	9264	8803	8803
query75	3231	3200	2683	2683
query76	3884	1183	752	752
query77	524	391	279	279
query78	10033	10067	9339	9339
query79	2623	792	604	604
query80	660	520	434	434
query81	509	278	239	239
query82	511	125	98	98
query83	178	166	150	150
query84	285	91	74	74
query85	823	350	295	295
query86	394	315	273	273
query87	4411	4614	4452	4452
query88	3610	2173	2131	2131
query89	410	321	286	286
query90	1802	194	191	191
query91	139	138	109	109
query92	79	59	56	56
query93	2146	1024	562	562
query94	696	415	295	295
query95	341	268	275	268
query96	479	566	263	263
query97	2837	2840	2767	2767
query98	226	204	207	204
query99	1393	1421	1259	1259
Total cold run time: 295219 ms
Total hot run time: 190456 ms

doris-robot · 2025-02-17T02:55:31Z

ClickBench: Total hot run time: 31.03 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 252a78747cb3aa6c80f446a173b3dfc14b4d148b, data reload: false
query1	0.04	0.04	0.04
query2	0.07	0.03	0.03
query3	0.23	0.06	0.07
query4	1.62	0.10	0.10
query5	0.42	0.43	0.39
query6	1.14	0.65	0.68
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.52	0.51
query10	0.59	0.58	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.62	0.60	0.60
query14	2.70	2.68	2.72
query15	0.92	0.86	0.86
query16	0.38	0.38	0.38
query17	1.00	1.01	1.03
query18	0.21	0.19	0.19
query19	1.92	1.88	1.95
query20	0.01	0.01	0.01
query21	15.37	0.88	0.53
query22	0.76	1.11	0.61
query23	15.08	1.38	0.64
query24	9.45	1.78	1.46
query25	0.54	0.24	0.09
query26	0.72	0.18	0.13
query27	0.06	0.04	0.06
query28	7.24	0.76	0.42
query29	12.53	3.89	3.27
query30	0.26	0.10	0.06
query31	2.82	0.59	0.39
query32	3.23	0.55	0.47
query33	3.04	2.95	3.04
query34	15.78	5.11	4.46
query35	4.52	4.51	4.56
query36	0.65	0.51	0.48
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.03	0.03	0.02
Total cold run time: 105.35 s
Total hot run time: 31.03 s

doris-robot · 2025-02-17T03:01:29Z

TeamCity be ut coverage result:
Function Coverage: 43.39% (11333/26118)
Line Coverage: 33.38% (95145/285051)
Region Coverage: 32.16% (48758/151589)
Branch Coverage: 27.97% (24579/87868)
Coverage Report: http://coverage.selectdb-in.cc/coverage/252a78747cb3aa6c80f446a173b3dfc14b4d148b_252a78747cb3aa6c80f446a173b3dfc14b4d148b/report/index.html

Gabriel39 · 2025-02-17T07:25:31Z

run buildall

doris-robot · 2025-02-17T07:45:58Z

TPC-H: Total hot run time: 31593 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8dd8285c5dbf3007232e08b83165f4b56790ba44, data reload: false
------ Round 1 ----------------------------------
q1	17594	5460	5036	5036
q2	2050	303	178	178
q3	10461	1369	731	731
q4	10292	1021	512	512
q5	8517	2528	2327	2327
q6	191	172	133	133
q7	894	749	594	594
q8	9279	1321	1116	1116
q9	5227	4713	4687	4687
q10	6827	2329	1876	1876
q11	455	269	251	251
q12	351	354	222	222
q13	17786	3635	3043	3043
q14	220	225	210	210
q15	498	455	453	453
q16	626	607	590	590
q17	576	864	343	343
q18	6615	6337	6227	6227
q19	1211	969	559	559
q20	306	333	196	196
q21	2639	2196	1998	1998
q22	363	322	311	311
Total cold run time: 102978 ms
Total hot run time: 31593 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5081	5137	5099	5099
q2	232	324	233	233
q3	2156	2721	2297	2297
q4	1426	1852	1380	1380
q5	4216	4157	4162	4157
q6	208	160	122	122
q7	1866	1826	1768	1768
q8	2658	2687	2574	2574
q9	7246	7106	7121	7106
q10	2966	3187	2733	2733
q11	569	500	497	497
q12	677	817	638	638
q13	3561	3907	3253	3253
q14	261	297	282	282
q15	511	471	458	458
q16	650	670	637	637
q17	1131	1565	1360	1360
q18	7534	7189	7207	7189
q19	777	861	874	861
q20	1958	2039	1853	1853
q21	5328	4861	4767	4767
q22	613	604	508	508
Total cold run time: 51625 ms
Total hot run time: 49772 ms

doris-robot · 2025-02-17T07:57:15Z

TPC-DS: Total hot run time: 182301 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8dd8285c5dbf3007232e08b83165f4b56790ba44, data reload: false
query1	972	376	388	376
query2	6518	1842	1862	1842
query3	6802	210	210	210
query4	26200	23346	22907	22907
query5	4396	671	533	533
query6	315	202	191	191
query7	4613	500	290	290
query8	304	243	230	230
query9	8634	2488	2501	2488
query10	478	314	246	246
query11	15490	15481	14780	14780
query12	169	105	114	105
query13	1666	505	387	387
query14	10444	6537	6138	6138
query15	202	189	175	175
query16	7642	616	473	473
query17	1274	693	539	539
query18	1976	392	299	299
query19	188	202	157	157
query20	119	119	122	119
query21	206	120	103	103
query22	4375	4271	4329	4271
query23	33915	32943	33023	32943
query24	7166	2351	2304	2304
query25	521	454	377	377
query26	1246	268	155	155
query27	2259	479	322	322
query28	4128	2372	2370	2370
query29	696	528	430	430
query30	227	185	152	152
query31	951	840	813	813
query32	71	63	62	62
query33	567	355	292	292
query34	780	831	501	501
query35	794	839	734	734
query36	969	984	874	874
query37	123	95	77	77
query38	4224	4158	4123	4123
query39	1437	1440	1399	1399
query40	206	117	103	103
query41	55	51	51	51
query42	121	105	98	98
query43	481	503	487	487
query44	1255	766	768	766
query45	178	168	162	162
query46	835	1031	636	636
query47	1783	1833	1786	1786
query48	370	403	302	302
query49	802	507	427	427
query50	700	717	402	402
query51	4158	4238	4030	4030
query52	101	103	92	92
query53	219	254	188	188
query54	477	461	423	423
query55	85	82	82	82
query56	262	258	246	246
query57	1147	1141	1092	1092
query58	242	230	253	230
query59	2611	2691	2498	2498
query60	288	286	275	275
query61	150	143	144	143
query62	778	706	671	671
query63	227	211	189	189
query64	4251	989	638	638
query65	3187	3136	3126	3126
query66	1056	414	309	309
query67	15800	15478	15298	15298
query68	3171	795	514	514
query69	465	300	262	262
query70	1202	1145	1107	1107
query71	396	289	263	263
query72	6074	3600	3716	3600
query73	758	732	339	339
query74	8893	9121	8707	8707
query75	3129	3170	2676	2676
query76	3201	1177	738	738
query77	469	362	278	278
query78	9929	9930	9325	9325
query79	1966	850	582	582
query80	675	550	433	433
query81	519	267	234	234
query82	407	127	95	95
query83	163	172	149	149
query84	242	87	72	72
query85	760	365	318	318
query86	390	325	259	259
query87	4450	4417	4458	4417
query88	2748	2188	2158	2158
query89	381	326	285	285
query90	1772	196	191	191
query91	134	142	108	108
query92	65	62	53	53
query93	1351	984	571	571
query94	625	406	290	290
query95	352	264	249	249
query96	474	549	265	265
query97	2754	2839	2784	2784
query98	228	207	196	196
query99	1277	1434	1246	1246
Total cold run time: 264302 ms
Total hot run time: 182301 ms

doris-robot · 2025-02-17T08:02:37Z

ClickBench: Total hot run time: 30.68 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8dd8285c5dbf3007232e08b83165f4b56790ba44, data reload: false
query1	0.04	0.04	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.10	0.10
query5	0.41	0.41	0.41
query6	1.17	0.66	0.67
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.59	0.52	0.52
query10	0.58	0.57	0.56
query11	0.16	0.10	0.10
query12	0.14	0.11	0.12
query13	0.64	0.60	0.60
query14	2.73	2.73	2.67
query15	0.92	0.86	0.86
query16	0.39	0.39	0.38
query17	1.00	1.00	1.02
query18	0.21	0.19	0.20
query19	1.96	1.84	2.03
query20	0.01	0.02	0.01
query21	15.39	0.89	0.54
query22	0.75	1.08	0.61
query23	15.15	1.36	0.63
query24	7.99	3.02	0.89
query25	0.42	0.27	0.09
query26	0.71	0.18	0.14
query27	0.05	0.05	0.04
query28	9.84	0.87	0.43
query29	12.88	3.99	3.32
query30	0.25	0.09	0.06
query31	2.82	0.58	0.39
query32	3.23	0.55	0.46
query33	3.00	3.05	3.06
query34	15.86	5.09	4.53
query35	4.56	4.51	4.59
query36	0.66	0.49	0.49
query37	0.09	0.06	0.07
query38	0.06	0.04	0.04
query39	0.03	0.02	0.02
query40	0.18	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.03	0.02	0.03
Total cold run time: 106.99 s
Total hot run time: 30.68 s

doris-robot · 2025-02-17T08:20:15Z

TeamCity be ut coverage result:
Function Coverage: 43.81% (11446/26126)
Line Coverage: 33.82% (96408/285074)
Region Coverage: 32.52% (49295/151606)
Branch Coverage: 28.19% (24770/87874)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8dd8285c5dbf3007232e08b83165f4b56790ba44_8dd8285c5dbf3007232e08b83165f4b56790ba44/report/index.html

github-actions · 2025-02-17T10:17:16Z

PR approved by at least one committer and no changes requested.

…pache#47911) The same block may be sent twice by TabletSinkHashPartitioner. To get the correct result, we should not send any rows the last time.

…table (apache#47911)" This reverts commit 03f1ac1.

…pache#47911) The same block may be sent twice by TabletSinkHashPartitioner. To get the correct result, we should not send any rows the last time.

…hPartitioner (#48720) Related PR: bug introduced by #44102, expanded by #45256, partially fixed by #47911 Problem Summary: also fixed Auto Partition + Auto Increment-Column may core dump in loading

…hPartitioner (apache#48720) Related PR: bug introduced by apache#44102, expanded by apache#45256, partially fixed by apache#47911 Problem Summary: also fixed Auto Partition + Auto Increment-Column may core dump in loading

Gabriel39 changed the title ~~[fix](auto partition) Fix duplicate rows in auto-patitioned table~~[fix](auto partition) Fix duplicate rows in auto-partitioned tableFeb 14, 2025

zclllyybb approved these changes Feb 14, 2025
View reviewed changes

github-actionsBot added the reviewed label Feb 14, 2025

BiteTheDDDDt previously approved these changes Feb 17, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Feb 17, 2025

Gabriel39 added 3 commits February 17, 2025 11:52

[fix](auto partition) Fix duplicate rows in auto-patitioned table
ef1965d

update
378735e

update
8dd8285

Gabriel39 dismissed BiteTheDDDDt’s stale review via 8dd8285February 17, 2025 07:25

Gabriel39 force-pushed the fix_insert branch from 252a787 to 8dd8285Compare February 17, 2025 07:25

github-actionsBot removed the approved Indicates a PR has been approved by one committer. label Feb 17, 2025

BiteTheDDDDt approved these changes Feb 17, 2025
View reviewed changes

Gabriel39 merged commit 03f1ac1 into apache:masterFeb 17, 2025

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Feb 17, 2025

zclllyybb added a commit to zclllyybb/doris that referenced this pull request Mar 5, 2025
Revert "[fix](auto partition) Fix duplicate rows in auto-partitioned …
e55471a
…table (apache#47911)" This reverts commit 03f1ac1.

zclllyybb mentioned this pull request Mar 5, 2025
[Refactor](shuffle) Fix wrong deal of batching block in TabletSinkHashPartitioner #48720
Merged
16 tasks

zclllyybb added a commit to zclllyybb/doris that referenced this pull request May 14, 2025
Revert "[fix](auto partition) Fix duplicate rows in auto-partitioned …
2b77edb
…table (apache#47911)" This reverts commit 03f1ac1.

zclllyybb added a commit to zclllyybb/doris that referenced this pull request May 14, 2025
Revert "[fix](auto partition) Fix duplicate rows in auto-partitioned …
3352f12
…table (apache#47911)" This reverts commit 03f1ac1.

zclllyybb added a commit to zclllyybb/doris that referenced this pull request May 16, 2025
Revert "[fix](auto partition) Fix duplicate rows in auto-partitioned …
60cdc99
…table (apache#47911)" This reverts commit 03f1ac1.

Gabriel39 deleted the fix_insert branch July 30, 2026 06:27

Uh oh!

Conversation

Gabriel39 commented Feb 14, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

hello-stephen commented Feb 14, 2025

Uh oh!

Gabriel39 commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

doris-robot commented Feb 14, 2025

Uh oh!

zclllyybb left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Feb 14, 2025

Uh oh!

Gabriel39 commented Feb 17, 2025

Uh oh!

github-actionsBot commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

Gabriel39 commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

doris-robot commented Feb 17, 2025

Uh oh!

github-actionsBot commented Feb 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Gabriel39 commented Feb 14, 2025•
edited
Loading