LMCache

LMCache Public

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python 11,025Apache-2.0 1,663 155 (3 issues need help) 318 Updated Aug 5, 2026

vllm-cpu Public

CPU only nightly vllm wheels

Shell 0 0 0 1 Updated Aug 4, 2026

LMCache-Ascend Public

LMCache on Ascend

Python 83Apache-2.0 45 48 (1 issue needs help) 6 Updated Jul 30, 2026

kvcache-view Public

KV cache visualizations

HTML 9 1 0 0 Updated Jul 28, 2026

opt-125m Public

0 0 0 0 Updated Jun 17, 2026

lmcache_frontend Public

the frontend of lmcache

Python 18 6 5 (1 issue needs help) 0 Updated Apr 22, 2026

lmcache-agent-trace Public

Agent application/benchmark/workload traces should be placed here.

Python 15Apache-2.0 6 0 1 Updated Apr 13, 2026

LMBenchmark Public

Systematic and comprehensive benchmarks for LLM systems.

Python 62Apache-2.0 26 2 0 Updated Jan 28, 2026

lmcache_redis Public

zero copy python sdk

Python 1 1 0 1 Updated Jan 21, 2026

LMBench Public

Modular Serving Engine x Workload Generator Benchmarking Tool

Python 11Apache-2.0 3 5 0 Updated Nov 19, 2025

Navigation Menu

Uh oh!

Uh oh!

LMCache

Popular repositories Loading

Repositories

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

People

Top languages

Uh oh!

Most used topics

Uh oh!