[opt](serde)Optimize the filling of fixed values ​​into block columns without repeated deserialization. (#37377)

[hubgeter]

bp #37377

Proposed changes

Since the value of the partition column is fixed when querying the partition table, we can deserialize the value only once and then repeatedly insert the value into the block.

in Hive: CREATETABLEparquet_partition_tb (
col1 STRING,
col2 INT,
col3 DOUBLE
) PARTITIONED BY (
partition_col1 STRING,
partition_col2 INT
)
STORED AS PARQUET;
insert into parquet_partition_tb partition (partition_col1="hello",partition_col2=1) values("word",2,2.3);
insert into parquet_partition_tb partition(partition_col1="hello",partition_col2=1 ) select col1,col2,col3 from parquet_partition_tb where partition_col1="hello"and partition_col2=1;
Repeat the `insert into xxx select xxx`operation several times.
Doris :
before:
mysql>selectcount(partition_col1) from parquet_partition_tb;
+-----------------------+
| count(partition_col1) |
+-----------------------+
| 33554432 |
+-----------------------+1 row inset (3.24 sec)
mysql>selectcount(partition_col2) from parquet_partition_tb;
+-----------------------+
| count(partition_col2) |
+-----------------------+
| 33554432 |
+-----------------------+1 row inset (3.34 sec)
after:
mysql>selectcount(partition_col1) from parquet_partition_tb ;
+-----------------------+
| count(partition_col1) |
+-----------------------+
| 33554432 |
+-----------------------+1 row inset (0.79 sec)
mysql>selectcount(partition_col2) from parquet_partition_tb;
+-----------------------+
| count(partition_col2) |
+-----------------------+
| 33554432 |
+-----------------------+1 row inset (0.51 sec)

Summary：

test sql select count(partition_col) from tbl;
Number of lines ： 33554432

	before	after
boolean	3.96	0.47
tinyint	3.39	0.47
smallint	3.14	0.50
int	3.34	0.51
bigint	3.61	0.51
float	4.59	0.51
double	4.60	0.55
decimal(5,2)	3.96	0.61
date	5.80	0.52
timestamp	7.68	0.52
string	3.24	0.79

Issue Number: close #xxx

Proposed changes

Issue Number: close #xxx

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[hubgeter]

run buildall

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[hubgeter]

run buildall

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[hubgeter]

run buildall

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[hubgeter]

run buildall

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[hubgeter]

run buildall

[github-actions]

clang-tidy review says "All clean, LGTM! 👍"

[doris-robot]

TeamCity be ut coverage result:
Function Coverage: 36.50% (9261/25370)
Line Coverage: 28.02% (75657/269968)
Region Coverage: 26.86% (38904/144833)
Branch Coverage: 23.59% (19752/83714)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b15f6df91902706bc03d15e6d352118e77cee7c1_b15f6df91902706bc03d15e6d352118e77cee7c1/report/index.html