CacheGen ======== .. note:: CacheGen KV cache compression for multiprocess mode is **not implemented yet** (coming soon). The original in-process implementation is preserved in the Legacy section: :doc:`/kv_cache_optimizations/compression/index`.