KV cache blending sounds like it would be super useful for Copilot-style code completion models.

You could cache the contents of each file, the edits made so far, the project README, recent commits, etc, separately, and blend them dynamically depending on what the user is doing.