[fix](paimon) Covert Paimon DeletionFile Path to StoragePath in fe by suxiaogang223 · Pull Request #49645 · apache/doris

suxiaogang223 · 2025-03-28T12:07:33Z

What problem does this PR solve?

Related PR: #34743

Problem Summary:
The problem occurs because FE passes the deletion file URL with 'oss://' prefix to BE, which cannot recognize this URL format. The solution is to convert the 'oss://' prefix to 's3://' prefix in FE's PaimonScanNode using LocationPath class to ensure BE can properly read the file.

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2025-03-28T12:07:38Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

suxiaogang223 · 2025-03-30T05:58:33Z

run buildall

doris-robot · 2025-03-30T06:35:58Z

TPC-H: Total hot run time: 34938 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6350c878880b9e619012862f23906394b6d3b2dc, data reload: false
------ Round 1 ----------------------------------
q1	26363	6110	5245	5245
q2	2096	293	168	168
q3	10404	1301	711	711
q4	12119	1026	544	544
q5	7478	2462	2335	2335
q6	187	167	137	137
q7	931	759	628	628
q8	9329	1348	1080	1080
q9	6971	5198	5298	5198
q10	6822	2363	1928	1928
q11	489	278	284	278
q12	360	365	226	226
q13	18146	4070	3408	3408
q14	250	247	229	229
q15	545	507	504	504
q16	638	627	598	598
q17	605	896	377	377
q18	9585	7477	7210	7210
q19	1380	990	566	566
q20	330	344	201	201
q21	4147	3374	2404	2404
q22	1065	1033	963	963
Total cold run time: 120240 ms
Total hot run time: 34938 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5194	5138	5167	5138
q2	252	344	236	236
q3	2193	2820	2451	2451
q4	1539	1946	1496	1496
q5	4490	4411	4378	4378
q6	232	182	132	132
q7	2131	2009	1864	1864
q8	2702	2697	2583	2583
q9	7082	7337	7201	7201
q10	3015	3172	2753	2753
q11	600	522	487	487
q12	689	752	657	657
q13	3521	4032	3280	3280
q14	296	313	285	285
q15	531	475	484	475
q16	660	688	637	637
q17	1176	1549	1436	1436
q18	7926	7738	7305	7305
q19	788	829	894	829
q20	1996	2101	1872	1872
q21	5391	4912	4840	4840
q22	1091	1009	1020	1009
Total cold run time: 53495 ms
Total hot run time: 51344 ms

doris-robot · 2025-03-30T06:47:51Z

TPC-DS: Total hot run time: 192583 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6350c878880b9e619012862f23906394b6d3b2dc, data reload: false
query1	1389	1056	1025	1025
query2	6141	1920	1902	1902
query3	11115	4854	4655	4655
query4	25276	23759	22949	22949
query5	4805	656	461	461
query6	309	199	204	199
query7	3992	494	274	274
query8	302	238	247	238
query9	8530	2514	2516	2514
query10	504	311	259	259
query11	15448	15106	15004	15004
query12	174	113	112	112
query13	1569	514	400	400
query14	9192	6250	6232	6232
query15	209	191	175	175
query16	7607	631	484	484
query17	1170	728	616	616
query18	2037	423	326	326
query19	205	208	176	176
query20	131	122	125	122
query21	219	128	111	111
query22	4775	4864	4619	4619
query23	34283	33560	33317	33317
query24	8572	2402	2451	2402
query25	507	462	403	403
query26	1182	275	146	146
query27	3048	507	341	341
query28	4671	2447	2415	2415
query29	697	559	429	429
query30	277	218	188	188
query31	970	836	771	771
query32	71	67	63	63
query33	574	416	320	320
query34	1142	850	517	517
query35	812	858	783	783
query36	995	1004	890	890
query37	117	99	81	81
query38	4283	4262	4093	4093
query39	1492	1458	1425	1425
query40	214	118	102	102
query41	53	53	59	53
query42	116	108	106	106
query43	511	506	473	473
query44	1297	811	815	811
query45	191	170	178	170
query46	872	1035	644	644
query47	1901	1922	1813	1813
query48	390	414	302	302
query49	786	511	415	415
query50	714	744	415	415
query51	4307	4265	4222	4222
query52	106	108	101	101
query53	233	261	179	179
query54	489	500	414	414
query55	82	85	81	81
query56	272	268	268	268
query57	1185	1201	1160	1160
query58	247	248	281	248
query59	2712	2863	2700	2700
query60	300	289	269	269
query61	137	136	130	130
query62	774	730	678	678
query63	220	189	183	183
query64	4193	1039	668	668
query65	4372	4223	4259	4223
query66	999	385	291	291
query67	15886	15667	15522	15522
query68	8828	879	498	498
query69	455	306	260	260
query70	1210	1129	1088	1088
query71	454	293	256	256
query72	5558	4754	4760	4754
query73	554	618	348	348
query74	9384	9121	8718	8718
query75	4068	3241	2727	2727
query76	3170	1174	742	742
query77	848	372	281	281
query78	9866	10132	9357	9357
query79	1772	823	623	623
query80	662	512	428	428
query81	467	265	224	224
query82	451	132	95	95
query83	209	170	154	154
query84	276	96	74	74
query85	770	342	303	303
query86	323	303	302	302
query87	4466	4589	4376	4376
query88	2841	2233	2222	2222
query89	391	302	275	275
query90	1946	199	206	199
query91	142	146	108	108
query92	80	57	57	57
query93	1163	1039	574	574
query94	683	420	312	312
query95	434	267	260	260
query96	480	557	277	277
query97	3192	3217	3146	3146
query98	219	212	199	199
query99	1438	1386	1268	1268
Total cold run time: 279151 ms
Total hot run time: 192583 ms

doris-robot · 2025-03-30T06:53:10Z

ClickBench: Total hot run time: 31.25 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6350c878880b9e619012862f23906394b6d3b2dc, data reload: false
query1	0.04	0.04	0.03
query2	0.13	0.10	0.10
query3	0.24	0.19	0.19
query4	1.58	0.20	0.19
query5	0.59	0.58	0.58
query6	1.18	0.72	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.57	0.54	0.51
query10	0.58	0.58	0.56
query11	0.16	0.10	0.10
query12	0.15	0.11	0.12
query13	0.60	0.60	0.59
query14	2.80	2.81	2.82
query15	0.92	0.86	0.85
query16	0.38	0.39	0.38
query17	1.03	1.00	1.02
query18	0.22	0.20	0.19
query19	1.90	1.97	1.81
query20	0.01	0.01	0.01
query21	15.36	0.88	0.55
query22	0.76	1.21	0.66
query23	14.91	1.37	0.66
query24	7.41	1.16	0.71
query25	0.44	0.14	0.22
query26	0.63	0.16	0.14
query27	0.06	0.05	0.05
query28	9.66	0.87	0.42
query29	12.56	4.01	3.37
query30	0.25	0.09	0.06
query31	2.85	0.59	0.38
query32	3.23	0.55	0.46
query33	3.06	3.03	3.03
query34	15.77	5.18	4.52
query35	4.50	4.54	4.52
query36	0.65	0.49	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.16	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.72 s
Total hot run time: 31.25 s

suxiaogang223 · 2025-03-31T17:23:08Z

run buildall

doris-robot · 2025-03-31T17:42:24Z

TPC-H: Total hot run time: 34229 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e2dfb37e42de971240a7831c083ee0b921547630, data reload: false
------ Round 1 ----------------------------------
q1	25869	5172	5051	5051
q2	2066	289	166	166
q3	10401	1232	691	691
q4	10227	1005	531	531
q5	7541	2377	2402	2377
q6	196	162	134	134
q7	921	756	615	615
q8	9327	1290	1047	1047
q9	6758	5156	5132	5132
q10	6808	2316	1890	1890
q11	467	289	263	263
q12	351	359	222	222
q13	17761	3700	3117	3117
q14	237	234	216	216
q15	529	484	488	484
q16	649	610	573	573
q17	585	847	356	356
q18	7626	7245	7115	7115
q19	1231	963	584	584
q20	331	335	200	200
q21	4453	3618	2508	2508
q22	1064	993	957	957
Total cold run time: 115398 ms
Total hot run time: 34229 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5161	5159	5131	5131
q2	237	323	228	228
q3	2117	2649	2249	2249
q4	1464	1832	1491	1491
q5	4555	4413	4409	4409
q6	212	166	132	132
q7	1969	1906	1728	1728
q8	2530	2563	2543	2543
q9	7266	7067	7055	7055
q10	2967	3141	2787	2787
q11	574	501	488	488
q12	717	785	603	603
q13	3563	3935	3318	3318
q14	264	279	266	266
q15	520	487	467	467
q16	647	678	652	652
q17	1177	1559	1405	1405
q18	7589	7537	7426	7426
q19	854	908	1138	908
q20	1997	2029	1881	1881
q21	5172	4649	4945	4649
q22	1064	1000	939	939
Total cold run time: 52616 ms
Total hot run time: 50755 ms

doris-robot · 2025-03-31T17:54:05Z

TPC-DS: Total hot run time: 185883 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e2dfb37e42de971240a7831c083ee0b921547630, data reload: false
query1	1008	499	472	472
query2	6547	1925	1921	1921
query3	6795	221	218	218
query4	25845	23403	23023	23023
query5	4385	697	498	498
query6	324	210	193	193
query7	4607	520	279	279
query8	305	263	251	251
query9	8639	2615	2615	2615
query10	509	317	257	257
query11	15936	14940	14887	14887
query12	172	106	106	106
query13	1641	514	404	404
query14	10160	6155	6301	6155
query15	204	187	164	164
query16	7642	641	477	477
query17	1279	691	536	536
query18	2006	392	306	306
query19	189	189	159	159
query20	124	114	119	114
query21	215	120	105	105
query22	4271	4142	4149	4142
query23	33656	32815	33009	32815
query24	8352	2390	2408	2390
query25	520	465	392	392
query26	1244	264	155	155
query27	2736	495	327	327
query28	4364	2410	2418	2410
query29	730	546	428	428
query30	288	217	190	190
query31	953	863	767	767
query32	77	67	71	67
query33	557	386	328	328
query34	793	827	527	527
query35	808	804	742	742
query36	957	980	871	871
query37	130	97	77	77
query38	4346	4188	4129	4129
query39	1476	1419	1409	1409
query40	213	127	115	115
query41	63	58	60	58
query42	123	109	108	108
query43	515	517	458	458
query44	1340	807	795	795
query45	180	182	175	175
query46	885	1057	643	643
query47	1743	1778	1717	1717
query48	396	434	306	306
query49	808	562	448	448
query50	716	765	419	419
query51	4205	4160	4159	4159
query52	116	108	102	102
query53	240	253	185	185
query54	515	517	434	434
query55	89	83	84	83
query56	307	289	281	281
query57	1144	1151	1071	1071
query58	264	256	248	248
query59	2734	2658	2551	2551
query60	293	277	260	260
query61	131	126	129	126
query62	791	721	682	682
query63	233	196	184	184
query64	4248	1013	692	692
query65	4384	4216	4259	4216
query66	1057	412	309	309
query67	16015	15691	15343	15343
query68	8790	890	522	522
query69	468	301	270	270
query70	1259	1155	1108	1108
query71	481	299	284	284
query72	5255	4686	4670	4670
query73	723	593	338	338
query74	8789	9069	8689	8689
query75	4059	3239	2685	2685
query76	3688	1207	766	766
query77	782	399	291	291
query78	10113	10054	9359	9359
query79	5077	828	569	569
query80	690	535	444	444
query81	481	261	221	221
query82	582	129	102	102
query83	219	183	166	166
query84	285	93	80	80
query85	814	356	312	312
query86	337	284	277	277
query87	4489	4352	4258	4258
query88	3424	2266	2274	2266
query89	451	318	283	283
query90	1978	221	223	221
query91	143	145	110	110
query92	79	68	59	59
query93	3108	1066	590	590
query94	725	415	309	309
query95	367	276	261	261
query96	505	574	284	284
query97	3197	3216	3131	3131
query98	238	209	207	207
query99	1451	1411	1277	1277
Total cold run time: 281585 ms
Total hot run time: 185883 ms

doris-robot · 2025-03-31T17:59:24Z

ClickBench: Total hot run time: 31.24 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e2dfb37e42de971240a7831c083ee0b921547630, data reload: false
query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.25	0.20	0.19
query4	1.59	0.19	0.20
query5	0.59	0.59	0.59
query6	1.17	0.72	0.72
query7	0.03	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.52	0.52
query10	0.60	0.60	0.57
query11	0.15	0.12	0.10
query12	0.14	0.12	0.12
query13	0.62	0.60	0.60
query14	2.68	2.78	2.68
query15	0.92	0.86	0.86
query16	0.38	0.39	0.39
query17	1.00	1.00	1.02
query18	0.21	0.20	0.20
query19	1.87	1.89	1.93
query20	0.02	0.02	0.01
query21	15.37	0.89	0.54
query22	0.77	1.08	0.60
query23	15.10	1.40	0.63
query24	7.16	2.12	0.59
query25	0.50	0.13	0.11
query26	0.61	0.17	0.14
query27	0.06	0.05	0.05
query28	9.19	0.89	0.45
query29	12.57	4.15	3.45
query30	0.27	0.09	0.06
query31	2.83	0.61	0.39
query32	3.23	0.54	0.47
query33	3.06	3.09	3.13
query34	15.78	5.11	4.57
query35	4.48	4.49	4.50
query36	0.67	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.13 s
Total hot run time: 31.24 s

suxiaogang223 · 2025-04-01T02:34:27Z

run buildall

suxiaogang223 · 2025-04-01T03:31:54Z

run buildall

doris-robot · 2025-04-01T03:51:48Z

TPC-H: Total hot run time: 34197 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bbdb8d6338311b9e28d20b42d6da7d851ee18410, data reload: false
------ Round 1 ----------------------------------
q1	26113	5110	5012	5012
q2	2072	283	188	188
q3	10507	1234	693	693
q4	10278	1003	532	532
q5	8713	2412	2326	2326
q6	188	161	130	130
q7	919	738	618	618
q8	9329	1295	1034	1034
q9	6875	5183	5189	5183
q10	6812	2287	1865	1865
q11	481	291	274	274
q12	350	351	218	218
q13	17744	3660	3075	3075
q14	234	229	207	207
q15	536	499	501	499
q16	634	616	581	581
q17	630	864	383	383
q18	7553	7121	7217	7121
q19	1515	949	562	562
q20	359	347	229	229
q21	3991	2624	2478	2478
q22	1026	1053	989	989
Total cold run time: 116859 ms
Total hot run time: 34197 ms
----- Round 2, with runtime_filter_mode=off -----
q1	5370	5105	5082	5082
q2	247	328	236	236
q3	2132	2659	2282	2282
q4	1444	1792	1494	1494
q5	4512	4476	4319	4319
q6	216	167	125	125
q7	1924	1925	1732	1732
q8	2554	2558	2541	2541
q9	7172	7160	7281	7160
q10	2972	3157	2724	2724
q11	562	505	505	505
q12	684	762	610	610
q13	3532	3971	3368	3368
q14	278	287	272	272
q15	528	460	467	460
q16	661	675	644	644
q17	1134	1515	1431	1431
q18	7755	7427	7379	7379
q19	820	878	990	878
q20	1968	2035	1834	1834
q21	5172	4616	4679	4616
q22	1106	1041	989	989
Total cold run time: 52743 ms
Total hot run time: 50681 ms

doris-robot · 2025-04-01T04:03:20Z

TPC-DS: Total hot run time: 186252 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bbdb8d6338311b9e28d20b42d6da7d851ee18410, data reload: false
query1	1018	482	465	465
query2	6576	1898	1874	1874
query3	6755	229	215	215
query4	26072	23466	22966	22966
query5	4334	636	472	472
query6	320	221	198	198
query7	4627	491	288	288
query8	304	255	240	240
query9	8623	2590	2555	2555
query10	469	321	263	263
query11	15301	15069	14900	14900
query12	154	110	106	106
query13	1645	546	388	388
query14	8799	6187	6287	6187
query15	206	197	172	172
query16	7175	653	466	466
query17	1217	759	597	597
query18	1981	415	323	323
query19	197	191	163	163
query20	124	121	122	121
query21	217	133	113	113
query22	4377	4271	4273	4271
query23	33944	32896	32953	32896
query24	8390	2417	2428	2417
query25	617	453	399	399
query26	1239	266	149	149
query27	2730	505	331	331
query28	4331	2410	2379	2379
query29	770	556	439	439
query30	292	217	206	206
query31	931	864	773	773
query32	73	62	67	62
query33	561	358	313	313
query34	798	868	583	583
query35	759	821	734	734
query36	1049	971	888	888
query37	120	99	75	75
query38	4252	4050	4098	4050
query39	1441	1425	1390	1390
query40	227	120	112	112
query41	57	55	55	55
query42	122	109	109	109
query43	493	506	479	479
query44	1341	826	805	805
query45	173	172	170	170
query46	832	1007	627	627
query47	1750	1796	1724	1724
query48	372	417	303	303
query49	783	526	432	432
query50	659	672	394	394
query51	4163	4188	4078	4078
query52	110	109	107	107
query53	231	261	181	181
query54	578	580	509	509
query55	91	82	79	79
query56	290	299	322	299
query57	1151	1125	1076	1076
query58	273	262	248	248
query59	2517	2614	2455	2455
query60	332	326	296	296
query61	134	129	129	129
query62	789	739	650	650
query63	221	190	190	190
query64	4364	1014	688	688
query65	4401	4235	4244	4235
query66	1142	418	306	306
query67	15775	15698	15236	15236
query68	8041	902	524	524
query69	480	303	263	263
query70	1247	1171	1095	1095
query71	465	331	309	309
query72	5423	4772	4766	4766
query73	732	596	343	343
query74	8843	8869	8862	8862
query75	3911	3210	2712	2712
query76	3737	1190	759	759
query77	799	390	284	284
query78	9964	10332	9352	9352
query79	1206	835	584	584
query80	589	512	459	459
query81	479	255	223	223
query82	375	124	100	100
query83	268	264	237	237
query84	251	116	85	85
query85	750	372	309	309
query86	346	303	281	281
query87	4398	4578	4357	4357
query88	2791	2220	2269	2220
query89	383	316	279	279
query90	2070	215	218	215
query91	149	143	111	111
query92	81	62	60	60
query93	1070	980	595	595
query94	673	412	310	310
query95	372	295	285	285
query96	483	559	279	279
query97	3122	3237	3111	3111
query98	232	206	203	203
query99	1422	1434	1281	1281
Total cold run time: 271311 ms
Total hot run time: 186252 ms

doris-robot · 2025-04-01T04:08:38Z

ClickBench: Total hot run time: 31.41 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bbdb8d6338311b9e28d20b42d6da7d851ee18410, data reload: false
query1	0.04	0.04	0.03
query2	0.13	0.10	0.11
query3	0.25	0.20	0.20
query4	1.60	0.20	0.20
query5	0.60	0.57	0.59
query6	1.19	0.71	0.70
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.52	0.52
query10	0.60	0.57	0.56
query11	0.17	0.10	0.11
query12	0.16	0.11	0.11
query13	0.61	0.60	0.60
query14	2.83	2.81	2.70
query15	0.95	0.85	0.85
query16	0.39	0.39	0.39
query17	1.06	1.00	1.03
query18	0.21	0.19	0.20
query19	1.93	1.94	1.80
query20	0.01	0.01	0.02
query21	15.36	0.92	0.54
query22	0.77	1.20	0.65
query23	14.90	1.37	0.62
query24	7.27	1.46	1.02
query25	0.52	0.21	0.14
query26	0.69	0.17	0.14
query27	0.06	0.05	0.04
query28	9.10	0.88	0.43
query29	12.52	4.01	3.35
query30	0.24	0.09	0.06
query31	2.82	0.59	0.40
query32	3.22	0.55	0.48
query33	3.04	3.03	3.10
query34	15.87	5.12	4.48
query35	4.51	4.55	4.57
query36	0.67	0.49	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.39 s
Total hot run time: 31.41 s

morningman

LGTM

github-actions · 2025-04-01T06:30:23Z

PR approved by at least one committer and no changes requested.

github-actions · 2025-04-01T06:30:26Z

PR approved by anyone and no changes requested.

…49645) ### What problem does this PR solve? Related PR: #34743 Problem Summary: The problem occurs because FE passes the deletion file URL with 'oss://' prefix to BE, which cannot recognize this URL format. The solution is to convert the 'oss://' prefix to 's3://' prefix in FE's PaimonScanNode using LocationPath class to ensure BE can properly read the file.

…ath in fe #49645 (#49751) Cherry-picked from #49645 Co-authored-by: Socrates <suyiteng@selectdb.com>

…ath in fe #49645 (#49750) Cherry-picked from #49645 Co-authored-by: Socrates <suyiteng@selectdb.com>

…pache#49645) ### What problem does this PR solve? Related PR: apache#34743 Problem Summary: The problem occurs because FE passes the deletion file URL with 'oss://' prefix to BE, which cannot recognize this URL format. The solution is to convert the 'oss://' prefix to 's3://' prefix in FE's PaimonScanNode using LocationPath class to ensure BE can properly read the file.

suxiaogang223 added 2 commits April 1, 2025 01:21

covert paimon uri in fe
14ba3a4

add case
e2dfb37

suxiaogang223 force-pushed the fix_paimon_dv_path branch from d5ffd73 to e2dfb37Compare March 31, 2025 17:21

fix case
dbc9fab

Merge branch 'master' into fix_paimon_dv_path
bbdb8d6

morningman approved these changes Apr 1, 2025
View reviewed changes

morningman added usercase Important user case type label dev/2.1.x dev/3.0.x labels Apr 1, 2025

hubgeter approved these changes Apr 1, 2025
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Apr 1, 2025

github-actionsBot added the reviewed label Apr 1, 2025

wuwenchi approved these changes Apr 1, 2025
View reviewed changes

zy-kkk approved these changes Apr 1, 2025
View reviewed changes

morningman merged commit 688e756 into apache:masterApr 2, 2025

github-actionsBot mentioned this pull request Apr 2, 2025
branch-3.0: [fix](paimon) Covert Paimon DeletionFile Path to StoragePath in fe #49645 #49750
Merged

github-actionsBot mentioned this pull request Apr 2, 2025
branch-2.1: [fix](paimon) Covert Paimon DeletionFile Path to StoragePath in fe #49645 #49751
Merged

yiguolei pushed a commit that referenced this pull request Apr 2, 2025
branch-2.1: [fix](paimon) Covert Paimon DeletionFile Path to StorageP…
0735c19
…ath in fe #49645 (#49751) Cherry-picked from #49645 Co-authored-by: Socrates <suyiteng@selectdb.com>

yiguolei added dev/2.1.10-merged and removed dev/2.1.x labels Apr 2, 2025

dataroaring pushed a commit that referenced this pull request Apr 22, 2025
branch-3.0: [fix](paimon) Covert Paimon DeletionFile Path to StorageP…
c2976b5
…ath in fe #49645 (#49750) Cherry-picked from #49645 Co-authored-by: Socrates <suyiteng@selectdb.com>

dataroaring added dev/3.0.6-merged and removed dev/3.0.x labels Apr 22, 2025

yiguolei mentioned this pull request May 13, 2025
2.1.10 Release Note #50853
Closed

gavinchou mentioned this pull request Jun 11, 2025
Release Note 3.0.6 #51585
Closed

suxiaogang223 deleted the fix_paimon_dv_path branch July 10, 2025 09:04

Uh oh!

Conversation

suxiaogang223 commented Mar 28, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Mar 28, 2025

Uh oh!

suxiaogang223 commented Mar 30, 2025

Uh oh!

doris-robot commented Mar 30, 2025

Uh oh!

doris-robot commented Mar 30, 2025

Uh oh!

doris-robot commented Mar 30, 2025

Uh oh!

suxiaogang223 commented Mar 31, 2025

Uh oh!

doris-robot commented Mar 31, 2025

Uh oh!

doris-robot commented Mar 31, 2025

Uh oh!

doris-robot commented Mar 31, 2025

Uh oh!

suxiaogang223 commented Apr 1, 2025

Uh oh!

suxiaogang223 commented Apr 1, 2025

Uh oh!

doris-robot commented Apr 1, 2025

Uh oh!

doris-robot commented Apr 1, 2025

Uh oh!

doris-robot commented Apr 1, 2025

Uh oh!

morningman left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Apr 1, 2025

Uh oh!

github-actionsBot commented Apr 1, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

9 participants

suxiaogang223 commented Mar 28, 2025•
edited
Loading