wehub-resource-sync
9 lines
258 B
ReStructuredText
9 lines
258 B
ReStructuredText
CacheGen
|
|
========
|
|
|
|
.. note::
|
|
|
|
CacheGen KV cache compression for multiprocess mode is **not implemented
|
|
yet** (coming soon). The original in-process implementation is preserved in
|
|
the Legacy section: :doc:`/kv_cache_optimizations/compression/index`.
|