Skip to content

[fix](inverted index) create empty idx file when creating a index on variant-type column (#50937) - #51180

Closed
csun5285 wants to merge 5131 commits into
apache:masterfrom
csun5285:pick_50937_3.0
Closed

[fix](inverted index) create empty idx file when creating a index on variant-type column (#50937)#51180
csun5285 wants to merge 5131 commits into
apache:masterfrom
csun5285:pick_50937_3.0

Conversation

@csun5285

@csun5285csun5285 commented May 23, 2025

Copy link
Copy Markdown
Contributor

pick from master #50937

github-actionsBotand others added 30 commits April 22, 2025 10:59
@github-actions@Mryange
branch-3.0: [feature](function) support utf8 input in initcapapache#…
35548b4
…49846 (apache#49933)
Cherry-picked from apache#49846
Co-authored-by: Mryange <yanxuecheng@selectdb.com>
@linrrzqqq@koi2000
branch-3.0: [Enhancement] Support some spatial functions (apache#48695)…
e7d4b9f
… (apache#50061)
pick: apache#48695 and
apache#49665
---------
Co-authored-by: koi <koi20000@163.com>
@github-actions@suxiaogang223
branch-3.0: [fix](paimon) Covert Paimon DeletionFile Path to StorageP…
c2976b5
…ath in fe apache#49645 (apache#49750)
Cherry-picked from apache#49645
Co-authored-by: Socrates <suyiteng@selectdb.com>
@github-actions@morningman
branch-3.0: [fix](meta) do not check replica allocation when replaya…
42d6afa
…pache#49569 (apache#49603)
Cherry-picked from apache#49569
Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
@github-actions@justfortaste
branch-3.0: [bugfix](hive) fix_hive_metastore_client_socket_timeouta…
dfad916
…pache#47378 (apache#50222)
Cherry-picked from apache#47378
Co-authored-by: zhangyuan <ayuanzhang@tencent.com>
@github-actions@feiniaofeiafei
branch-3.0: [fix](nereids) fix generate column need add cast in strea…
ae32003
…m load apache#49167 (apache#50029)
Cherry-picked from apache#49167
Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
@924060929@morrySnow
branch-3.0: [fix](Nereids) cse extract wrong expression from lambda e…
962c009
…xpressions apache#49166 (apache#49941)
cherry pick from apache#49166
Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
@bobhan1
branch-3.0-pick: [Fix](cloud-mow) Fix race between `CloudMetaMgr::syn…
750da9f
…c_tablet_rowsets` and `CloudSchemaChangeJob::_convert_historical_rowsets` (apache#50051) (apache#50081)
pick apache#50051
@Jibing-Li
branch-3.0:[fix](nereids)Use utf-8 when convert string like literal t…
39e26d2
…o double. (apache#50085) (apache#50153)
backport: apache#50085
@github-actions@airborne12
branch-3.0: [Fix](inverted index) fix rename column build index buga…
d22a26e
…pache#50056 (apache#50169)
Cherry-picked from apache#50056
Co-authored-by: airborne12 <jiangkai@selectdb.com>
@bobhan1
branch-3.0-pick: [Fix](cloud-mow) Handle tablet delete bitmap calcula…
a2a87f2
…tion task's return value unifiedly in CloudEngineCalcDeleteBitmapTask::execute apache#50019 (apache#50045)
pick apache#50019
@eldenmoon
Branch-3.0 Cherry-pick [Fix](Variant) fix variant cast to jsonb into …
415c2fc
…wrong NULL values (apache#50180) (apache#50234)
cherry-pick from apache#50180
@github-actions@BePPPower
branch-3.0: [fix](Export) fix the lock leak issue of Exportapache#50088
328c694
 (apache#50218)
Cherry-picked from apache#50088
Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
@felixwluo
branch-3.0: [fix](agg) prevent core dump in ColumnArray::size_at when…
a461be6
… handling type mismatch in streaming_agg_serialize_to_column apache#50001 (apache#50098)
Cherry-picked from: apache#50001
@github-actions@morningman
branch-3.0: [fix](hive/iceberg) rectify the fs name if path already c…
4d575fd
…ontains fs apache#49998 (apache#50197)
Cherry-picked from apache#49998
Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
@github-actions@yiguolei
branch-3.0: [enhancement](memoryfailed) throw exception instead of lo…
11fdbb5
…g fatal during memory allocate failed apache#49876 (apache#49896)
Cherry-picked from apache#49876
Co-authored-by: yiguolei <guolei@selectdb.com>
@github-actions@zclllyybb
branch-3.0: [Fix](function) fix wrong length check of function array_…
45569bb
…range apache#49993 (apache#49997)
Cherry-picked from apache#49993
Co-authored-by: zclllyybb <zhaochangle@selectdb.com>
@Jibing-Li
branch-3.0:[fix](statistics)No need to forward show table stats comma…
b6de049
…nd. (apache#50207) (apache#50229)
backport: apache#50207
@zclllyybb
[branch-3.0](lock) Remove SpinLock compeletely (apache#49972)
e450a7d
### What problem does this PR solve?
Issue Number: close #xxx
Related PR: apache#49872
Problem Summary:
### Release note
None
### Check List (For Author)
- Test <!-- At least one of them must be included. -->
- [ ] Regression test
- [ ] Unit Test
- [ ] Manual test (add detailed scripts or steps below)
- [x] No need to test or manual test. Explain why:
- [x] This is a refactor/code format and no logic has been changed.
- [ ] Previous test can cover this change.
- [ ] No code files have been changed.
- [ ] Other reason <!-- Add your reason? -->
- Behavior changed:
- [x] No.
- [ ] Yes. <!-- Explain the behavior change -->
- Does this need documentation?
- [x] No.
- [ ] Yes. <!-- Add document PR link here. eg:
apache/doris-website#1214 -->
### Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
@github-actions@feiniaofeiafei
branch-3.0: [fix](nereids) EliminateGroupByConstant should replace ag…
52c31d5
…g's group by after removing constant group by keys apache#49473 (apache#50043)
Cherry-picked from apache#49473
Co-authored-by: feiniaofeiafei <moailing@selectdb.com>
@github-actions@hubgeter
branch-3.0: [fix](parquet)fix when hive_parquet_use_column_names=fals…
1db091a
…e && read partition tb cause be core. apache#49966 (apache#50007)
Cherry-picked from apache#49966
Co-authored-by: daidai <changyuwei@selectdb.com>
@github-actions@hubgeter
branch-3.0: [fix](mc)Fixed the issue that maxcompute catalog can only…
a8fd878
… read part of the timestamp data apache#49600 (apache#49705)
Cherry-picked from apache#49600
Co-authored-by: daidai <changyuwei@selectdb.com>
@morningman
branch-3.0: [fix](oss) the write to hive table on oss-hdfs may fail (a…
ebbe891
…pache#49754) (apache#50284)
bp apache#49754
@github-actions@BePPPower
branch-3.0: [Fix](TrinoConnector) it will return error when query `in…
b2b0dae
…formation_schema.tables` within `trino-connector` catalog apache#49912 (apache#50006)
Cherry-picked from apache#49912
Co-authored-by: Tiewei Fang <fangtiewei@selectdb.com>
@github-actions@morningman
branch-3.0: [opt](hive) add option to get schema from table objectap…
8969a6b
…ache#50038 (apache#50268)
Cherry-picked from apache#50038
Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
@github-actions@wuwenchi
branch-3.0: [fix](iceberg) Fix the failure of creating a table in OBSa…
0577ffd
…pache#49983 (apache#50018)
Cherry-picked from apache#49983
Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
@kaka11chen
branch-3.0: [chore] Updated submodule orc to orc-for-doris-21 branch. (…
ae11bd4
…apache#50190)
[chore] Updated submodule orc to orc-for-doris-21 branch.
@morningman@hello-stephen
[deps](jindofs) add jindofs for 2.1 (apache#49259)(apache#49371)(apac…
8aff230
…he#49374)(apache#49502)(apache#49503)(apache#49886)(apache#49903)(apache#49963) (apache#50283)
bp (apache#49259)(apache#49371)(apache#49374)(apache#49502)(apache#49503)(apache#49886)(apache#49903)(apache#49963)
---------
Co-authored-by: Dongyang Li <lidongyang@selectdb.com>
@github-actions@Yukang-Lian
branch-3.0: [Fix](compaction) Only print delete compaction log when t…
a72ce5e
…here is a delete rowset apache#49953 (apache#50291)
Cherry-picked from apache#49953
Co-authored-by: abmdocrt <lianyukang@selectdb.com>
@github-actions@sollhui
branch-3.0: [fix](load) fix routine load job progress fallback after …
681ac90
…FE master node restart apache#50221 (apache#50282)
Cherry-picked from apache#50221
Co-authored-by: hui lai <laihui@selectdb.com>
github-actionsBotand others added 20 commits May 17, 2025 21:47
@github-actions@xy720
branch-3.0: [bug](cloud) Fix npe when show cluster load statisticapa…
25d7592
…che#50866 (apache#50992)
Cherry-picked from apache#50866
Co-authored-by: xy720 <22125576+xy720@users.noreply.github.com>
@mrhhsg
[fix](jsonb) Avoid crashing caused by invalid path (apache#50978) (ap…
e06e252
…ache#50994)
pick apache#50978
@zddr
branch-3.0: [fix](mtmv)before mtmv refresh,check column type if change (
69368b3
apache#50768)
pick: apache#49041
@MoanasDaddyXu
branch-3.0: [Test](IAMROLE) update IAMROLE export cases (apache#51035)
23a5cd1
@github-actions@deardeng
branch-3.0: [fix](cloud) Add check for cluster_name empty in cloudap…
8a3626c
…ache#49775 (apache#50072)
Cherry-picked from apache#49775
Co-authored-by: deardeng <dengxin@selectdb.com>
@deardeng
branch-3.0: [fix](cloud) Some resource APIs should not check if clust…
aa67fd8
…er_name is empty apache#50148 (apache#51046)
cherry pick from apache#50148
@github-actions@zddr
branch-3.0: [fix](meta) replace partition should not get table versio…
59b6c9e
…n in cloud mode apache#50888 (apache#51027)
Cherry-picked from apache#50888
Co-authored-by: zhangdong <zhangdong@selectdb.com>
@github-actions@Yukang-Lian
branch-3.0: [Fix](compaction) Failed compaction tablets should sleep …
24c5767
…before being selected again apache#50672 (apache#51030)
Cherry-picked from apache#50672
Co-authored-by: abmdocrt <lianyukang@selectdb.com>
@zy-kkk
branch-3.0: [hotfix](jdbc catalog) Fix jdbcclient repeated initializa…
ddbc99a
…tion (apache#51037)
pick apache#51036
@mymeiyi
branch-3.0: [fix](group commit) reduce cpu cost for group_commit get_…
212cd8f
…block apache#49822 (apache#51079)
pick apache#49822
@github-actions@morrySnow
branch-3.0: [fix](metadata) replace view will break view's metadataa…
53e33c8
…pache#51058 (apache#51074)
Cherry-picked from apache#51058
Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
@BiteTheDDDDt
[Improvement](memory) reduce some memtracker overhead (apache#50063) (a…
8bb8ec1
…pache#51068)
pick from apache#50063
@xinyiZzz
branch-3.0: [fix](memory) Fix `ThreadMemTrackerMgr::limiter_mem_track…
42a3466
…er()` performance (apache#50525)
pick apache#50462
@Yukang-Lian@Yoruet
[Cherry-pick](branch-3.0) Pick "[Feature](Compaction)Improve Compacti…
1992e53
…on Profiling and Logging apache#50950" (apache#51125)
Pick apache#50950 Co-authored-by: yoruet <1559650411@qq.com>
@github-actions@starocean999
branch-3.0: [fix](planner)comparing partition column name should be c…
819d39f
…ase insensitive when pruning partition in DeleteJob apache#50674 (apache#51113)
Cherry-picked from apache#50674
Co-authored-by: starocean999 <lichi@selectdb.com>
@github-actions@csun5285
branch-3.0: [fix](case) fix some unstable p2 casesapache#50697(apac…
1173e26
…he#51064)
Cherry-picked from apache#50697
Co-authored-by: Sun Chenyang <sunchenyang@selectdb.com>
@github-actions@sollhui
branch-3.0: [improve](load) introduce black list of backend when load…
898fe41
… job fetch meta to avoid jitter apache#50587 (apache#51043)
Cherry-picked from apache#50587
Co-authored-by: hui lai <laihui@selectdb.com>
@github-actions@924060929
branch-3.0: [fix](nereids) fix subquery unnest can not found aggregat…
566cc51
…e slot apache#51086 (apache#51137)
Cherry-picked from apache#51086
Co-authored-by: 924060929 <lanhuajian@selectdb.com>
@csun5285
[fix](inverted index) create empty idx file when creating a index on …
b4a08bd
…variant-type column (apache#50937)
create empty idx file when creating a index on variant-type column
@csun5285
pick fix
f7e6589
@hello-stephen

hello-stephen commented May 23, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@gavinchougavinchouAwaiting requested review from gavinchougavinchou is a code owner
@dataroaringdataroaringAwaiting requested review from dataroaringdataroaring is a code owner
@w41terw41terAwaiting requested review from w41ter
@morningmanmorningmanAwaiting requested review from morningmanmorningman is a code owner
@yiguoleiyiguoleiAwaiting requested review from yiguoleiyiguolei is a code owner
@xiaokangxiaokangAwaiting requested review from xiaokangxiaokang is a code owner
@CalvinKirsCalvinKirsAwaiting requested review from CalvinKirsCalvinKirs is a code owner
@BiteTheDDDDtBiteTheDDDDtAwaiting requested review from BiteTheDDDDt

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

20 participants

@csun5285@hello-stephen@linrrzqqq@924060929@bobhan1@Jibing-Li@eldenmoon@felixwluo@zclllyybb@morningman@kaka11chen@CalvinKirs@suxiaogang223@wuwenchi@morrySnow@freemandealer@Hastyshell@Yukang-Lian@dataroaring@hubgeter