Skip to content

[fix](DOE)es catalog not working with pipeline,datetimev2, array and esquery - #22046

Merged
xiaokang merged 3 commits into
apache:masterfrom
qidaye:fix_doe
Aug 1, 2023
Merged

[fix](DOE)es catalog not working with pipeline,datetimev2, array and esquery#22046
xiaokang merged 3 commits into
apache:masterfrom
qidaye:fix_doe

Conversation

@qidaye

@qidayeqidaye commented Jul 20, 2023•
edited
Loading

Copy link
Copy Markdown
Contributor

Proposed changes

Issue Number: close#21853

  1. fix es catalog is not working with pipeline
  2. fix datetime convert bugs
  3. fix doc_value_fields not working with Doris Array.
  4. fix esquery function not working

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@qidaye
qidaye marked this pull request as draft July 20, 2023 13:07
@github-actions

github-actionsBot commented Jul 20, 2023

Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@xiaokangxiaokang added dev/2.0.0 2.0.0 release dev/2.0.1 and removed dev/2.0.0 2.0.0 release labels Jul 21, 2023
@morningman

morningman commented Jul 27, 2023

Copy link
Copy Markdown
Contributor

run buildall

@hello-stephen

hello-stephen commented Jul 27, 2023

Copy link
Copy Markdown
Contributor

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.02 seconds
stream load tsv: 508 seconds loaded 74807831229 Bytes, about 140 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 30 seconds loaded 861443392 Bytes, about 27 MB/s
insert into select: 29.1 seconds inserted 10000000 Rows, about 343K ops/s
storage size: 17169069615 Bytes

@github-actions

github-actionsBot commented Aug 1, 2023

Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@github-actions

github-actionsBot commented Aug 1, 2023

Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@qidaye
qidaye marked this pull request as ready for review August 1, 2023 11:18
@qidayeqidaye changed the title [fix](DOE)es catalog not working for pipeline,datetimev2 and array[fix](DOE)es catalog not working with pipeline,datetimev2, array and esqueryAug 1, 2023
@qidaye

qidaye commented Aug 1, 2023

Copy link
Copy Markdown
ContributorAuthor

run buildall

@github-actions

github-actionsBot commented Aug 1, 2023

Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

morningman
morningman approved these changes Aug 1, 2023
View reviewed changes

@morningmanmorningman left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@morningmanmorningman added dev/2.0.0 2.0.0 release and removed dev/2.0.1 labels Aug 1, 2023
@github-actions

github-actionsBot commented Aug 1, 2023

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actionsgithub-actionsBot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 1, 2023
@github-actions

github-actionsBot commented Aug 1, 2023

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@hello-stephen

hello-stephen commented Aug 1, 2023

Copy link
Copy Markdown
Contributor

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 48.2 seconds
stream load tsv: 513 seconds loaded 74807831229 Bytes, about 139 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.5 seconds inserted 10000000 Rows, about 338K ops/s
storage size: 17162334816 Bytes

xiaokang
xiaokang approved these changes Aug 1, 2023
View reviewed changes

@xiaokangxiaokang left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xiaokang
xiaokang merged commit b839914 into apache:masterAug 1, 2023
@xiaokangxiaokang added dev/2.0.0-merged and removed dev/2.0.0 2.0.0 release labels Aug 1, 2023
@qidaye
qidaye deleted the fix_doe branch August 1, 2023 14:02
This was referenced Aug 1, 2023
Closed
Closed
xiaokang pushed a commit that referenced this pull request Aug 1, 2023
@qidaye@xiaokang
[fix](DOE) es catalog not working with pipeline,datetimev2, array and…
f5de92b
… esquery (#22046)
qidaye added a commit to qidaye/incubator-doris that referenced this pull request Aug 7, 2023
@qidaye
[fix](DOE) es catalog not working with pipeline,datetimev2, array and…
dab998d
… esquery (apache#22046)
qidaye added a commit to qidaye/incubator-doris that referenced this pull request Aug 7, 2023
@qidaye
[fix](DOE) es catalog not working with pipeline,datetimev2, array and…
968cca2
… esquery (apache#22046)
@qidayeqidaye mentioned this pull request Aug 8, 2023
Merged
morningman pushed a commit that referenced this pull request Aug 8, 2023
@qidaye
[pick](DOE) pick doe fixes from master to branch-1.2-lts (#22685)
2bcf6c2
PRs:
1. #17566 2. #17412 3. #17745 4. #22279 5. #22046 6. #22423
GoGoWen pushed a commit to GoGoWen/incubator-doris that referenced this pull request Sep 7, 2023
@qidayecaiconghui1
[pick](DOE) pick doe fixes from master to branch-1.2-lts (apache#22685)
9bc5fbf
PRs:
1. apache#17566 2. apache#17412 3. apache#17745 4. apache#22279 5. apache#22046 6. apache#22423
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@xiaokangxiaokangxiaokang approved these changes
@morningmanmorningmanmorningman approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.dev/2.0.0-mergedreviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Bug] 'Unsupported exec type in pipeline: ES_HTTP_SCAN_NODE' when query es catalog

4 participants

@qidaye@morningman@hello-stephen@xiaokang