PRKV: Training-Free KV Cache Eviction for Efficient Long-Context Inference
Researchers have introduced PRKV, a novel method for KV cache eviction that uses Personalized PageRank over attention-induced transition graphs. This technique estimates global token importance beyond simple recency, allowing for up to 90% compression of the KV cache without requiring model retraining.