chore: import upstream snapshot with attribution

2026-07-13 12:24:33 +08:00
commit f213ec8976
2101 changed files with 494002 additions and 0 deletions
@@ -0,0 +1,26 @@
+CacheBlend
+==========
+
+CacheBlend lets LMCache reuse the KV cache of **any** repeated text chunk --
+not only a shared prefix -- by selectively recomputing a small fraction of
+tokens at chunk boundaries. This cuts time-to-first-token for RAG and
+multi-document workloads where the reusable context is not a clean prefix.
+
+Enabling CacheBlend (MP mode)
+-----------------------------
+
+Start the LMCache server with the blend engine:
+
+.. code-block:: bash
+
+   lmcache server --l1-size-gb 20 --eviction-policy LRU --engine-type blend
+
+The ``blend`` engine composes a ``BlendModule`` into the server and requires
+``--supported-transfer-mode`` to be ``lmcache_driven`` or ``auto`` (the default). See
+:doc:`/mp/configuration` for the related server flags.
+
+.. note::
+
+   The in-process CacheBlend documentation -- configuration knobs such as
+   ``LMCACHE_ENABLE_BLENDING`` and an end-to-end example -- is preserved in
+   the Legacy section: :doc:`/kv_cache_optimizations/blending`.