installation.md 457 Bytes
Newer Older
1
2
3
4
5
6
(installation-index)=

# Installation

vLLM supports the following hardware platforms:

7
:::{toctree}
8
:maxdepth: 1
9
:hidden:
10

11
12
13
installation/gpu
installation/cpu
installation/ai_accelerator
14
:::
15

16
- <project:installation/gpu.md>
17
18
19
  - NVIDIA CUDA
  - AMD ROCm
  - Intel XPU
20
- <project:installation/cpu.md>
21
22
23
  - Intel/AMD x86
  - ARM AArch64
  - Apple silicon
24
  - IBM Z (S390X)
25
- <project:installation/ai_accelerator.md>
26
27
28
  - Google TPU
  - Intel Gaudi
  - AWS Neuron