npu.md 473 Bytes
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
# NPU

vLLM-Omni supports NPU through the vLLM Ascend Plugin (vllm-ascend). This is a community maintained hardware plugin for running vLLM on NPU.

## Requirements

- OS: Linux
- Python: 3.12

!!! note
    vLLM-Omni is currently not natively supported on Windows.

=== "NPU"

    --8<-- "docs/getting_started/installation/npu/npu.inc.md:requirements"

## Installation

### Recommended

=== "NPU"

    --8<-- "docs/getting_started/installation/npu/npu.inc.md:installation"