Uh oh!
There was an error while loading. Please reload this page.
[Improment](executor)Add workload group id in workload policy's property - #33483
Conversation
doris-robot
commented
Apr 10, 2024
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
2 similar comments
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
1 similar comment
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
wangbo
commented
Apr 12, 2024
run buildall |
doris-robot
commented
Apr 12, 2024
TeamCity be ut coverage result: |
| return false; | ||
| } | ||
| public class PolicyProcNode { |
There was a problem hiding this comment.
这个proc 功能,我们如果有了系统表,感觉可以不要了,直接删了吧。我们不维护了。
There was a problem hiding this comment.
等加上policy的schema table时就删
| private volatile int priority; | ||
| @SerializedName(value = "wgId") | ||
| private long workloadGroupId; |
There was a problem hiding this comment.
what is the default value when upgrade from old version.
Uh oh!
There was an error while loading. Please reload this page.
| new Column("Priority", ScalarType.createType(PrimitiveType.INT)), | ||
| new Column("Enabled", ScalarType.createType(PrimitiveType.BOOLEAN)), | ||
| new Column("Version", ScalarType.createType(PrimitiveType.INT))); | ||
| new Column("Version", ScalarType.createType(PrimitiveType.INT)), |
There was a problem hiding this comment.
需要修改对应的regression test。
- 新建policy的时候指定group name, group 不存在异常的处理。
- 修改已经存在的policy,指定group name。
- drop 已经存在的group,关联policy和不关联policy。
clang-tidy review says "All clean, LGTM! 👍" |
6 similar comments
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
clang-tidy review says "All clean, LGTM! 👍" |
wangbo
commented
Apr 16, 2024
run p0 |
wangbo
commented
Apr 16, 2024
run buildall |
doris-robot
commented
Apr 16, 2024
TPC-H: Total hot run time: 38844 ms |
doris-robot
commented
Apr 16, 2024
TPC-DS: Total hot run time: 184404 ms |
doris-robot
commented
Apr 16, 2024
ClickBench: Total hot run time: 29.87 s |
doris-robot
commented
Apr 16, 2024
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' |
doris-robot
commented
Apr 16, 2024
TeamCity be ut coverage result: |
| private volatile int priority; | ||
| @SerializedName(value = "wgId") | ||
| private long workloadGroupId = -1; |
There was a problem hiding this comment.
store as a list, because user may bind to multi workload groups in the future.
clang-tidy review says "All clean, LGTM! 👍" |
wangbo
commented
Apr 17, 2024
run buildall |
clang-tidy review says "All clean, LGTM! 👍" |
PR approved by at least one committer and no changes requested. |
PR approved by anyone and no changes requested. |
doris-robot
commented
Apr 17, 2024
TPC-H: Total hot run time: 39047 ms |
doris-robot
commented
Apr 17, 2024
TPC-DS: Total hot run time: 184892 ms |
doris-robot
commented
Apr 17, 2024
ClickBench: Total hot run time: 30.32 s |
doris-robot
commented
Apr 17, 2024
Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G' |
doris-robot
commented
Apr 17, 2024
TeamCity be ut coverage result: |
Proposed changes
I think the similar workload should be within the same workload group, so a workload group may has many workload policy, but a workload policy should be only binded in one workload group.
I add a
workload_group_idproperty for workload schedule, then a policy with a valid workload group id can only match the workload in its own group.The default value of
workload_group_idis -1 ,it means all queries in the cluster may be limited by the policy.Drop workload group check
If a workload group has a related policy, it can not be dropped.
you need drop policy first or clear policy's workload group property.