lmcache--lmcache/examples/cache_controller

Examples of Cache Controller APIs

LMCache offers various ochestration APIs which can be used for routing (e.g., KV cache lookup) or hot context migration (e.g., KV cache move/migration).

Here are a few examples:

• KV cache clear
• KV cache compress
• KV cache lookup
• KV cache move
• KV cache pin

Unsupported APIs (WIP):

• KV cache decompress
• KV cache unpin