wehub/vllm-project--vllm

Files

T

History

wehub-resource-sync 7ce4c8e27e

pre-commit / pre-run-check (push) Has been cancelled

Details

pre-commit / pre-commit (push) Has been cancelled

Details

chore: import upstream snapshot with attribution

2026-07-13 12:55:37 +08:00

..

disagg_proxy_demo.py

chore: import upstream snapshot with attribution

2026-07-13 12:55:37 +08:00

disagg_proxy_multiturn.py

chore: import upstream snapshot with attribution

2026-07-13 12:55:37 +08:00

disagg_proxy_pushconnector_demo.py

chore: import upstream snapshot with attribution

2026-07-13 12:55:37 +08:00

kv_events.sh

chore: import upstream snapshot with attribution

2026-07-13 12:55:37 +08:00

moriio_toy_proxy_server.py

chore: import upstream snapshot with attribution

2026-07-13 12:55:37 +08:00

README.md

chore: import upstream snapshot with attribution

2026-07-13 12:55:37 +08:00

README.md

Disaggregated Serving

This example contains scripts that demonstrate the disaggregated serving features of vLLM.

Files

disagg_proxy_demo.py - Demonstrates XpYd (X prefill instances, Y decode instances).
kv_events.sh - Demonstrates KV cache event publishing.
mooncake_connector - A proxy demo for MooncakeConnector.