Skip to content

GitLab

"tests/vscode:/vscode.git/clone" did not exist on "dd248f76756adba4a1637b882e79ab639f957feb"
Unverified Commit 2176778c authored by Milos Puzovic's avatar Milos Puzovic Committed by GitHub
Browse files

[Doc] Add Arm CPUs are on the list of supported targets in vLLM (#26018) 


Signed-off-by: default avatarMilos Puzovic <milos.puzovic@arm.com>
parent 0370679c
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
docs/README.md
View file @ 2176778c
......@@ -56,7 +56,7 @@ vLLM is flexible and easy to use with:
- Tensor, pipeline, data and expert parallelism support for distributed inference
- Streaming outputs
- OpenAI-compatible API server
- Support for NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs and GPUs, PowerPC CPUs, and TPU. Additionally, support for diverse hardware plugins such as Intel Gaudi, IBM Spyre and Huawei Ascend.
- Support for NVIDIA GPUs, AMD CPUs and GPUs, Intel CPUs and GPUs, PowerPC CPUs, Arm CPUs and TPU. Additionally, support for diverse hardware plugins such as Intel Gaudi, IBM Spyre and Huawei Ascend.
- Prefix caching support
- Multi-LoRA support
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment