[Spark load][Be 1/1] Be handle push task - #3742

Merged

morningman merged 11 commits into

apache:masterfrom

xy720:spark_load_be_branch

Jun 22, 2020

xy720 commented Jun 1, 2020•
edited
Loading

Member

1、Add a PushBrokerReader in push_handle.cpp.
2、PushBrokerReader wraps the ParquetScanner to support reading data from parquet format file through broker.

xy720 mentioned this pull request

[Spark load] Doris support Spark load #3433

Closed

kangkaisen reviewed

View reviewed changes

be/src/olap/push_handler.h Outdated

kangkaisen reviewed

View reviewed changes

be/src/olap/push_handler.cpp Outdated

kangkaisen reviewed

View reviewed changes

be/src/olap/push_handler.cpp

kangkaisen reviewed

View reviewed changes

be/src/olap/push_handler.cpp Outdated

kangkaisen reviewed

View reviewed changes

be/src/olap/push_handler.cpp

xy720 added 4 commits

June 4, 2020 15:25

submit-spark-load-be-part

99e6ed7

fix run-ut.sh

00332c2

fix ut test data

6c9a7db

add comments

c97c3b0

xy720 force-pushed the spark_load_be_branch branch from 6dde2f9 to c97c3b0Compare

June 4, 2020 07:30

xy720 added 2 commits

June 4, 2020 15:41

change functionName finalize to close

3277082

fix ut

b0cbadd

wyb reviewed

View reviewed changes

be/src/olap/push_handler.cpp Outdated

be/src/olap/push_handler.cpp Outdated

be/src/olap/push_handler.cpp

xy720 added 2 commits

June 5, 2020 13:28

reset function name to finalize

395ada0

set function name to close

9500dd7

kangkaisen reviewed

View reviewed changes

be/src/olap/push_handler.cpp Outdated

kangkaisen reviewed

View reviewed changes

be/src/olap/olap_common.h Outdated

xy720 added 2 commits

June 22, 2020 14:43

use unique_ptr

1479c7d

fix unique_ptr

e7d643d

kangkaisen previously approved these changes

View reviewed changes

kangkaisen left a comment

Contributor

+1, LGTM

fix some mistake

3bf38c0

xy720 dismissed kangkaisen’s stale review via 3bf38c0

June 22, 2020 11:34

xy720 requested a review from kangkaisen

June 22, 2020 11:35

morningman approved these changes

View reviewed changes

morningman left a comment

Contributor

LGTM

morningman merged commit f189a2e into apache:master

hubgeter pushed a commit to hubgeter/doris that referenced this pull request

[Fix](partial update) Fix incorrect result when partial update includ…

45e9719

…e delete sign columns apache#46194 (apache#3742)
pick apache#46194

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment