[feature](score) support BM25 scoring in inverted index query_v2 by zzzxl1993 · Pull Request #59847 · apache/doris

zzzxl1993 · 2026-01-13T14:52:29Z

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes.

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2026-01-13T14:52:35Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

airborne12 · 2026-03-12T06:50:14Z

run buildall

doris-robot · 2026-03-12T07:26:57Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.31% (1798/2267)
Line Coverage	64.60% (32264/49944)
Region Coverage	65.54% (16161/24659)
Branch Coverage	55.95% (8610/15388)

airborne12 · 2026-03-12T07:34:39Z

run buildall

doris-robot · 2026-03-12T08:00:06Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.53% (32279/50023)
Region Coverage	65.45% (16166/24699)
Branch Coverage	55.85% (8608/15414)

airborne12 · 2026-03-12T11:47:47Z

run buildall

hello-stephen · 2026-03-12T12:29:47Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.53% (32284/50026)
Region Coverage	65.44% (16166/24702)
Branch Coverage	55.81% (8603/15416)

airborne12 · 2026-03-13T14:28:56Z

run buildall

airborne12 · 2026-03-13T14:57:12Z

run buildall

hello-stephen · 2026-03-13T15:37:25Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.50% (32267/50026)
Region Coverage	65.42% (16161/24702)
Branch Coverage	55.81% (8604/15416)

hello-stephen · 2026-03-13T16:16:58Z

FE UT Coverage Report

Increment line coverage 33.33% (2/6) 🎉
Increment coverage report
Complete coverage report

airborne12 · 2026-03-14T04:09:16Z

run buildall

hello-stephen · 2026-03-14T04:48:50Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.53% (32281/50026)
Region Coverage	65.40% (16155/24702)
Branch Coverage	55.83% (8606/15416)

airborne12 · 2026-03-14T05:48:09Z

run buildall

hello-stephen · 2026-03-14T06:35:12Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.51% (32274/50026)
Region Coverage	65.44% (16165/24702)
Branch Coverage	55.84% (8608/15416)

airborne12 · 2026-03-14T09:38:42Z

run buildall

doris-robot · 2026-03-14T10:21:13Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.49% (32260/50026)
Region Coverage	65.40% (16155/24702)
Branch Coverage	55.81% (8603/15416)

hello-stephen · 2026-03-14T10:57:57Z

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	52.65% (19758/37526)
Line Coverage	36.25% (184492/509010)
Region Coverage	32.38% (142459/440010)
Branch Coverage	33.56% (62263/185507)

hello-stephen · 2026-03-14T11:00:23Z

FE UT Coverage Report

Increment line coverage 33.33% (2/6) 🎉
Increment coverage report
Complete coverage report

hello-stephen · 2026-03-14T12:26:11Z

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	73.19% (26884/36730)
Line Coverage	56.54% (286815/507286)
Region Coverage	53.71% (238525/444057)
Branch Coverage	55.47% (103176/185989)

airborne12 · 2026-03-14T14:37:40Z

run buildall

doris-robot · 2026-03-14T15:19:35Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	79.24% (1798/2269)
Line Coverage	64.52% (32277/50026)
Region Coverage	65.42% (16161/24702)
Branch Coverage	55.83% (8607/15416)

eldenmoon

LGTM

github-actions · 2026-03-17T01:50:06Z

PR approved by at least one committer and no changes requested.

github-actions · 2026-03-17T01:50:08Z

PR approved by anyone and no changes requested.

airborne12

LGTM

…che#59847)

…uery_v2 #59847 (#61470) ## Proposed changes Cherry-pick #59847 to branch-4.0. Original PR: #59847 ## Further comments Resolved cherry-pick conflicts caused by directory renames (`be/src/storage/` → `be/src/olap/`, `be/src/exprs/` → `be/src/vec/exprs/`) in branch-4.0. Key conflict resolutions: - Updated all include paths for branch-4.0 directory structure - Added `vectorized::` namespace qualifiers for types (`VExprSPtr`, `VSlotRef`, etc.) - Added `IndexExecContext` constructor parameters for segment/iter_opts - Disabled nested group search (not available in branch-4.0) - Excluded unrelated fields (`enable_adjust_conjunct_order_by_cost`, `enable_paimon_cpp_reader`, `single_backend_query`, `cteMaxRecursionDepth`) from thrift/SessionVariable --------- Co-authored-by: zzzxl <yangsiyu@selectdb.com>

…che#59847)

…uery_v2 #59847 (#61472) ## Proposed changes Cherry-pick #59847 to branch-4.1. Original PR: #59847 ## Further comments Resolved cherry-pick conflicts (minor differences from branch-4.0 pick): - Added `IndexQueryContextPtr` member and `set/get_index_query_context` to `IndexExecContext` - Extended `evaluate_inverted_index_with_search_param` with `index_query_context` parameter - Added `enable_inverted_index_wand_query` to thrift and SessionVariable (field 203) - Kept existing branch-4.1 fields (`single_backend_query` field 202) intact --------- Co-authored-by: zzzxl <yangsiyu@selectdb.com>

zzzxl1993 requested a review from zclllyybb as a code owner January 13, 2026 14:52

zzzxl1993 force-pushed the 202501132239 branch from af09f14 to c27674eCompare January 15, 2026 04:15

airborne12 force-pushed the 202501132239 branch from c27674e to dcfab4aCompare March 12, 2026 06:26

airborne12 self-requested a review as a code owner March 12, 2026 06:26

airborne12 force-pushed the 202501132239 branch from dcfab4a to 2992a70Compare March 12, 2026 07:33

airborne12 force-pushed the 202501132239 branch from 2992a70 to 5568949Compare March 12, 2026 11:38

airborne12 force-pushed the 202501132239 branch from dfb96b0 to 67ec1ebCompare March 13, 2026 14:57

airborne12 mentioned this pull request Mar 14, 2026
[fix](clucene) Fix GCC -Werror compilation errors in TermDocsBuffer and SegmentTermVector apache/doris-thirdparty#384
Merged
3 tasks

eldenmoon approved these changes Mar 17, 2026
View reviewed changes

github-actionsBot added the approved Indicates a PR has been approved by one committer. label Mar 17, 2026

github-actionsBot added the reviewed label Mar 17, 2026

airborne12 approved these changes Mar 17, 2026
View reviewed changes

airborne12 merged commit 26c1950 into apache:masterMar 17, 2026
27 of 30 checks passed

airborne12 added dev/4.0.x dev/4.1.x labels Mar 17, 2026

github-actionsBot added dev/4.0.x-conflict dev/4.1.x-conflict labels Mar 17, 2026

airborne12 pushed a commit to airborne12/apache-doris that referenced this pull request Mar 18, 2026
[feature](score) support BM25 scoring in inverted index query_v2 (apa…
d731bf0
…che#59847)

airborne12 mentioned this pull request Mar 18, 2026
branch-4.0: [feature](score) support BM25 scoring in inverted index query_v2 #59847 #61470
Merged

airborne12 pushed a commit to airborne12/apache-doris that referenced this pull request Mar 18, 2026
[feature](score) support BM25 scoring in inverted index query_v2 (apa…
b1c77d7
…che#59847)

airborne12 pushed a commit to airborne12/apache-doris that referenced this pull request Mar 18, 2026
[feature](score) support BM25 scoring in inverted index query_v2 (apa…
4a5d6d0
…che#59847)

airborne12 mentioned this pull request Mar 18, 2026
branch-4.1: [feature](score) support BM25 scoring in inverted index query_v2 #59847 #61472
Merged

airborne12 pushed a commit to airborne12/apache-doris that referenced this pull request Mar 18, 2026
[feature](score) support BM25 scoring in inverted index query_v2 (apa…
36f6c68
…che#59847)

airborne12 pushed a commit to airborne12/apache-doris that referenced this pull request Mar 18, 2026
[feature](score) support BM25 scoring in inverted index query_v2 (apa…
094e120
…che#59847)

yiguolei added dev/4.0.5-merged and removed dev/4.0.x dev/4.0.x-conflict labels Mar 19, 2026

airborne12 pushed a commit to airborne12/apache-doris that referenced this pull request Mar 19, 2026
[feature](score) support BM25 scoring in inverted index query_v2 (apa…
e82c418
…che#59847)

yiguolei added dev/4.1.0-merged and removed dev/4.1.x dev/4.1.x-conflict labels Mar 19, 2026

yiguolei mentioned this pull request Mar 27, 2026
4.0.5 Release Notes #61817
Closed

morningman mentioned this pull request Jul 3, 2026
[Discuss] Doris Roadmap 2026 #60036
Open
76 tasks

ixzc mentioned this pull request Jul 15, 2026
[Bug] Report error when use Relevance Score function and search function for FULLTEXT Search #59888
Open
3 tasks

Uh oh!

Conversation

zzzxl1993 commented Jan 13, 2026

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Jan 13, 2026

Uh oh!

airborne12 commented Mar 12, 2026

Uh oh!

doris-robot commented Mar 12, 2026

Cloud UT Coverage Report

Uh oh!

airborne12 commented Mar 12, 2026

Uh oh!

doris-robot commented Mar 12, 2026

Cloud UT Coverage Report

Uh oh!

airborne12 commented Mar 12, 2026

Uh oh!

hello-stephen commented Mar 12, 2026

Cloud UT Coverage Report

Uh oh!

airborne12 commented Mar 13, 2026

Uh oh!

airborne12 commented Mar 13, 2026

Uh oh!

hello-stephen commented Mar 13, 2026

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Mar 13, 2026

FE UT Coverage Report

Uh oh!

airborne12 commented Mar 14, 2026

Uh oh!

hello-stephen commented Mar 14, 2026

Cloud UT Coverage Report

Uh oh!

airborne12 commented Mar 14, 2026

Uh oh!

hello-stephen commented Mar 14, 2026

Cloud UT Coverage Report

Uh oh!

airborne12 commented Mar 14, 2026

Uh oh!

doris-robot commented Mar 14, 2026

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Mar 14, 2026

BE UT Coverage Report

Uh oh!

hello-stephen commented Mar 14, 2026

FE UT Coverage Report

Uh oh!

hello-stephen commented Mar 14, 2026

BE Regression && UT Coverage Report

Uh oh!

airborne12 commented Mar 14, 2026

Uh oh!

doris-robot commented Mar 14, 2026

Cloud UT Coverage Report

Uh oh!

eldenmoon left a comment

Choose a reason for hiding this comment

Uh oh!

github-actionsBot commented Mar 17, 2026

Uh oh!

github-actionsBot commented Mar 17, 2026

Uh oh!

airborne12 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone