Skip to content

[branch-2.0][catalog](paimon)paimon catalog supports complex types - #26190

Merged
xiaokang merged 2 commits into
apache:branch-2.0from
DongLiang-0:paimon_complex_2.0
Nov 1, 2023
Merged

[branch-2.0][catalog](paimon)paimon catalog supports complex types#26190
xiaokang merged 2 commits into
apache:branch-2.0from
DongLiang-0:paimon_complex_2.0

Conversation

@DongLiang-0

Copy link
Copy Markdown
Contributor

Proposed changes

from
#25364
#25834

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@github-actionsgithub-actionsBot added kind/docs Categorizes issue or PR as related to documentation. kind/test labels Nov 1, 2023
zddr
zddr approved these changes Nov 1, 2023
@github-actions

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@DongLiang-0DongLiang-0 changed the title [feature](paimon)paimon catalog supports complex types[pick-25364,25834](paimon)paimon catalog supports complex typesNov 1, 2023
@DongLiang-0

Copy link
Copy Markdown
ContributorAuthor

run buildall

@DongLiang-0DongLiang-0 changed the title [pick-25364,25834](paimon)paimon catalog supports complex types[branch-2.0][catalog](paimon)paimon catalog supports complex typesNov 1, 2023
@doris-robot

Copy link
Copy Markdown

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 46.4 seconds
stream load tsv: 559 seconds loaded 74807831229 Bytes, about 127 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 65 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 30.0 seconds inserted 10000000 Rows, about 333K ops/s
storage size: 17162974622 Bytes

@DongLiang-0

Copy link
Copy Markdown
ContributorAuthor

run buildall

@DongLiang-0

Copy link
Copy Markdown
ContributorAuthor

run Build Extensions

@doris-robot

Copy link
Copy Markdown

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.5 seconds
stream load tsv: 555 seconds loaded 74807831229 Bytes, about 128 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.5 seconds inserted 10000000 Rows, about 338K ops/s
storage size: 17162858093 Bytes

@DongLiang-0

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

Copy link
Copy Markdown

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 47.17 seconds
stream load tsv: 553 seconds loaded 74807831229 Bytes, about 129 MB/s
stream load json: 20 seconds loaded 2358488459 Bytes, about 112 MB/s
stream load orc: 64 seconds loaded 1101869774 Bytes, about 16 MB/s
stream load parquet: 31 seconds loaded 861443392 Bytes, about 26 MB/s
insert into select: 29.5 seconds inserted 10000000 Rows, about 338K ops/s
storage size: 17164279131 Bytes

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dev/2.0.3-mergedkind/docsCategorizes issue or PR as related to documentation.kind/testreviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@DongLiang-0@doris-robot@zddr@xiaokang