Results for “AdamCaviness/cache-magic”

Keeps a handoff while a large session's prompt cache is still warm. On a five-minute cache, a late prompt can go out after the handoff instead of the full context. On a one-hour cache the session stays, and compaction is pointed at the handoff.