Skip to content

GitLab

"git@developer.sourcefind.cn:gaoqiong/pybind11.git" did not exist on "479e9a50f38cfa8e525a697d7f5d850f851223b5"
Commit d6e82889 authored by luopl's avatar luopl
Browse files

add K100 AI

parent 34f7565d
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
README.md
View file @ d6e82889
......@@ -87,6 +87,9 @@ export VLLM_MLA_DISABLE=0
export VLLM_USE_FLASH_MLA=1
export VLLM_RPC_TIMEOUT=1800000
# K100_AI集群建议额外设置的环境变量：
export VLLM_ENFORCE_EAGER_BS_THRESHOLD=44
# 海光CPU绑定核
export VLLM_NUMA_BIND=1
export VLLM_RANK0_NUMA=0
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment