[Roadmap] Support Struct+Map Type

[xy720]

Search before asking

• I had searched in the issues and found no similar issues.

Description

Struct + Map todo list

• 语法支持 (2.0)
  • 建表+desc语句 [Feature](Complex-type) Add struct and map type to Doris #16444
  • StructLiteral [Feature](Complex-type) Add struct and map type to Doris #16444
  • MapLiteral [Feature](Complex-type) Add struct and map type to Doris #16444
• Insert (2.0)
  • Map [Feature](Complex-type) Add struct and map type to Doris #16444
  • Struct [fix](struct-type) fix insert null and explain for struct type #16054
• Select (2.0)
  • Map [Feature](Complex-type) Add struct and map type to Doris #16444
  • Struct [Feature](Complex-type) Add struct and map type to Doris #16444
• Delete (2.0)
  • Map [Bug](complex-type) Fix is null predicate in delete stmt for array/struct/map type #17018
  • Struct [Bug](complex-type) Fix is null predicate in delete stmt for array/struct/map type #17018
• 子类型支持 (2.0)
  • struct field 支持 scala type [fix](struct-type) fix struct subtype support #17081
  • struct field 支持 nullable [fix](struct-type) fix struct subtype support #17081
  • map key/value 支持 scala type [Improve](map-type) Add contains_null for map  #16948
• Struct嵌套类型支持
  • Array 嵌套 Struct
  • Struct 嵌套 Struct
  • Struct 嵌套 Array
• Map嵌套类型支持
  • value 嵌套 Array
  • value 嵌套 Struct
  • value 嵌套 Map
• Cast (2.0)
  • Struct 隐式 Cast 函数 [Feature](struct-type) Add implicitly cast for struct-type #16613
  • Map 隐式 Cast 函数 [Feature](Complex-type) Add struct and map type to Doris #16444
  • 显式 Struct CastTo Struct [feature](struct-type) support CAST AS Struct type #17553
  • 显式 Map CastTo Map
  • 显式 StructLiteral CastTo StructLiteral [feature](struct-type) support CAST AS Struct type #17553
  • 显式 MapLiteral CastTo MapLiteral
• 导入 (2.0)
• Struct
  • Json格式 [feature](struct-type) adjust the vexpr for struct type #15669
  • csv格式 [feature](struct-type) support csv format stream load for struct type #17143
  • parquet格式
  • orc格式
• Map
  • Json格式 [Feature](map-type) Support stream load and fix some bugs for map type #16776
  • csv格式 [Feature](map-type) Support stream load and fix some bugs for map type #16776
  • parquet格式
  • orc格式
• 导出
• Struct
  • select into outfile [Improve](struct)improve struct support into outfile #19894
  • export
• Map
  • select into outfile
  • export
• 函数
• Struct
  • struct(val1, val2, val3, ...) [feature](struct-type) support basic struct constructor function #18190
  • named_struct(name1, val1, name2, val2, ...) [feature](struct-type) support basic struct constructor function #18190
  • s.x
  • explode(STRUCT<TYPES...>)
• Map
  • map(key1, val1, key2, val2, ...) [feature](map) basic functions for map datatype #16916
  • M[key]/element_at [feature](map) basic functions for map datatype #16916
  • size/cardinality(Map<K,V>) [feature](map) basic functions for map datatype #16916
  • map_keys(Map<K,V>) [feature](map) basic functions for map datatype #16916
  • map_values(Map<K,V>) [feature](map) basic functions for map datatype #16916
  • map_entries(Map<K,V>)
  • map_contains_key(Map<K,V> map, K key) [feature](map) basic functions for map datatype #16916
  • map_contains_value(Map<K,V> map, K key) [feature](map) basic functions for map datatype #16916
  • map_contains_key_like(Map<K,V> map, pattern)
  • explode(MAP<K,V> m)
  • map_concat(Map<K,V> map1, Map<K,V> map2, ...)
  • str_to_map(text[, delimiter1, delimiter2])
  • map_filter(MAP<K,V> m, func)
  • map_zip_with(MAP<K,V> map1, MAP<K,V> map2, func)
  • map_add(MAP<K,V> map1, MAP<K,V> map2, ...)
  • map_substract(MAP<K,V> map1, MAP<K,V> map2, ...)
  • map_update(MAP<K,V> map1, MAP<K,V> map2)
• 功能改善
• Struct
  • field支持写入default值
  • field支持comment
  • 支持Struct作为subquery的结果返回
• Schema change
• Struct
  • 增减 struct 列
  • 修改 struct field 类型
  • 增减 struct field
• Map
  • 增减 map 列
  • 修改 map 类型
• 外部数据源支持
• Struct
  • hive
  • iceberg
• Map
  • hive
  • iceberg
• 新优化器支持
• 支持各个索引
• 支持unique key

Related issues

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[xiaokang]

• support in new optimizer

[zhannngchen]

BTW, please consider supporting the unique key table.

[xiaokang]

add: support index