All issues

Search results

The issue of understanding the meanings of several terms in the paper.

Status: Open.

#33In FasterDecoding/SnapKV;

· loyceCG0523 opened on Oct 10, 2025

Confusion in Selecting Indices

Status: Open.

#31In FasterDecoding/SnapKV;

· Lueci4er opened on Apr 25, 2025

About Needle in a Haystack test

Status: Open.

#30In FasterDecoding/SnapKV;

· YUECHE77 opened on Apr 7, 2025

What's the exact meaning of 8.2x enhancement in memory efficiency, prompting latency, and generation latency? Can you provide the evaluation code?

Status: Open.

#29In FasterDecoding/SnapKV;

· xinhaoH opened on Mar 21, 2025

Bug on Qwen2-VL

Status: Open.

#28In FasterDecoding/SnapKV;

· LiJunscs opened on Jan 10, 2025

The first generation token output sees the whole cache key and value

Status: Open.

#27In FasterDecoding/SnapKV;

· PengWenChen opened on Jan 6, 2025

Question: is key_state_compressed used for inference?

Status: Open.

#24In FasterDecoding/SnapKV;

· jq-wei opened on Nov 20, 2024

What happens to the total KV length > max-compacity length during response generation?

Status: Open.

#23In FasterDecoding/SnapKV;

· PengWenChen opened on Oct 23, 2024

Group Query Attention

Status: Open.

#22In FasterDecoding/SnapKV;

· SimJeg opened on Oct 3, 2024

Question on H2O experiment reproduction

Status: Open.

#21In FasterDecoding/SnapKV;

· CUHKSZzxy opened on Aug 8, 2024

Could you provide the code for visualization the Hit Rate?

Status: Open.

#19In FasterDecoding/SnapKV;

· Dominic789654 opened on Jul 1, 2024

Can snapkv compress kv in case different user questions are posed towards the same context?

Status: Open.

#18In FasterDecoding/SnapKV;

· namespace-Pt opened on Jun 27, 2024