Skip to content

fix autoTP bloom inference when require_tp_fused_qkvw=True - #4157

Closed
dc3671 wants to merge 1 commit into
deepspeedai:masterfrom
dc3671:fix-bloom-autotp-inf
Closed

dc3671 wants to merge 1 commit into
deepspeedai:masterfrom
dc3671:fix-bloom-autotp-inf

fix autoTP bloom inference when require_tp_fused_qkvw=True

01f68cf
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs