vllm-project--vllm-omni/docs/getting_started/installation/npu.md

NPU

vLLM-Omni supports NPU through the vLLM Ascend Plugin (vllm-ascend). This is a community maintained hardware plugin for running vLLM on NPU.

Requirements

• OS: Linux
• Python: 3.12

!!! note vLLM-Omni is currently not natively supported on Windows.

=== "NPU"

--8<-- "docs/getting_started/installation/npu/npu.inc.md:requirements"

Installation

Set up using Docker

=== "NPU"

--8<-- "docs/getting_started/installation/npu/npu.inc.md:pre-built-images"

Build wheel from source

=== "NPU release"

--8<-- "docs/getting_started/installation/npu/npu.inc.md:installation-release"

=== "NPU from main"

--8<-- "docs/getting_started/installation/npu/npu.inc.md:installation-main"