chore: import upstream snapshot with attribution
This commit is contained in:
@@ -0,0 +1,15 @@
|
||||
# Examples of Cache Controller APIs
|
||||
|
||||
LMCache offers various ochestration APIs which can be used for routing (e.g., KV cache lookup) or hot context migration (e.g., KV cache move/migration).
|
||||
|
||||
Here are a few examples:
|
||||
|
||||
- [KV cache clear](clear/)
|
||||
- [KV cache compress](compress/)
|
||||
- [KV cache lookup](lookup/)
|
||||
- [KV cache move](move/)
|
||||
- [KV cache pin](pin/)
|
||||
|
||||
Unsupported APIs (WIP):
|
||||
- [KV cache decompress](decompress/)
|
||||
- [KV cache unpin](unpin/)
|
||||
Reference in New Issue
Block a user