Skip to content
#

trillium

Star

Here is 1 public repository matching this topic...

Language:Python
Filter by language
All 10 Rust 5 Shell 3 Python 1 TypeScript 1

RubensZimbres / TPU_Inference

Star 3

Measurement harness for the sliding window attention premium in the vLLM TPU Ragged Paged Attention v3 kernel: per layer decode cost, block size control, throughput, and goodput for Gemma 4 31B on TPU v6e.

google-cloudattention-mechanismgemmapallasgpu-kernelstpujaxinference-optimizationtpu-benchmarkstpustpu-accelerationtrilliumkernel-optimizersvllmllm-inferencepaged-attentionsliding-window-attentionvllm-servekernel-optimizationgoodput
  • Updated Jul 29, 2026
  • Python

Improve this page

Add a description, image, and links to the trillium topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the trillium topic, visit your repo's landing page and select "manage topics."

Learn more