ConceptShared History Attention Cache
Shared History Attention Cache
An inference optimization technique that reuses the attention cache of previously encoded history across multiple sampling runs, avoiding redundant computation on identical historical input and improving the efficiency of generating multiple paths.
Timeline (last 90 days)
Oct 16
PathFM uses a shared history attention cache to reuse the history encoding across multiple samplings, avoiding repeated computation.
Unverified50%