wehub-resource-sync
15 lines
442 B
Markdown
15 lines
442 B
Markdown
# Examples of Cache Controller APIs
|
|
|
|
LMCache offers various ochestration APIs which can be used for routing (e.g., KV cache lookup) or hot context migration (e.g., KV cache move/migration).
|
|
|
|
Here are a few examples:
|
|
|
|
- [KV cache clear](clear/)
|
|
- [KV cache compress](compress/)
|
|
- [KV cache lookup](lookup/)
|
|
- [KV cache move](move/)
|
|
- [KV cache pin](pin/)
|
|
|
|
Unsupported APIs (WIP):
|
|
- [KV cache decompress](decompress/)
|
|
- [KV cache unpin](unpin/) |