Skip to content

Tensor-parallel like FeedForward to lower memory requirements - #10623

Closed
a-r-r-o-w wants to merge 2 commits into
mainfrom
memory-optimizations/tensor-parallel-like-ff
Closed

Tensor-parallel like FeedForward to lower memory requirements#10623
a-r-r-o-w wants to merge 2 commits into
mainfrom
memory-optimizations/tensor-parallel-like-ff

fix geglu and swiglu gate computation

278b3b8
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs