wehub-resource-sync
9 lines
263 B
Markdown
9 lines
263 B
Markdown
# Examples vLLM + LMCache w. remote backends
|
|
LMCache should be able to reduce the generation time of the second and following calls.
|
|
|
|
We have examples for the following backends:
|
|
|
|
- Infinistore: `infinistore/`
|
|
- Mooncake: `mooncakestore/`
|
|
- External: `external/`
|