compactions

Here is 1 public repository matching this topic...

Optimize GPU memory use in vLLM by offloading MoE experts based on REAP data to reduce CPU-GPU transfers and improve performance.

Add a description, image, and links to the compactions topic page so that developers can more easily learn about it.

To associate your repository with the compactions topic, visit your repo's landing page and select "manage topics."