Unverified Commit 925d2f19 authored by Jun Duan's avatar Jun Duan Committed by GitHub
Browse files

[Doc] Fix typo for x86 CPU installation (#12514)


Signed-off-by: default avatarJun Duan <jun.duan.phd@outlook.com>
parent 8f58a513
...@@ -18,7 +18,7 @@ vLLM initially supports basic model inferencing and serving on x86 CPU platform, ...@@ -18,7 +18,7 @@ vLLM initially supports basic model inferencing and serving on x86 CPU platform,
::: :::
```{note} ```{note}
- AVX512_BF16 is an extension ISA provides native BF16 data type conversion and vector product instructions, will brings some performance improvement compared with pure AVX512. The CPU backend build script will check the host CPU flags to determine whether to enable AVX512_BF16. - AVX512_BF16 is an extension ISA provides native BF16 data type conversion and vector product instructions, which brings some performance improvement compared with pure AVX512. The CPU backend build script will check the host CPU flags to determine whether to enable AVX512_BF16.
- If you want to force enable AVX512_BF16 for the cross-compilation, please set environment variable `VLLM_CPU_AVX512BF16=1` before the building. - If you want to force enable AVX512_BF16 for the cross-compilation, please set environment variable `VLLM_CPU_AVX512BF16=1` before the building.
``` ```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment