wehub/lmcache--lmcache

Files

T

wehub-resource-sync f213ec8976 chore: import upstream snapshot with attribution

2026-07-13 12:24:33 +08:00

263 B

Raw Permalink Blame History

Examples vLLM + LMCache w. remote backends

LMCache should be able to reduce the generation time of the second and following calls.

We have examples for the following backends:

Infinistore: infinistore/
Mooncake: mooncakestore/
External: external/