Skip to content

GitLab

Unverified Commit 9f81df28 authored by Biswa Panda's avatar Biswa Panda Committed by GitHub
Browse files

feat: add vllm_v1 framework to run command (#1550)

parent 7609c0dc
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
container/run.sh
View file @ 9f81df28
...@@ -24,7 +24,7 @@ RUN_PREFIX= ...@@ -24,7 +24,7 @@ RUN_PREFIX=
# dependencies are specified in the /container/deps folder and # dependencies are specified in the /container/deps folder and
# installed within framework specific sections of the Dockerfile. # installed within framework specific sections of the Dockerfile.
declare -A FRAMEWORKS=(["VLLM"]=1 ["TENSORRTLLM"]=2 ["SGLANG"]=3) declare -A FRAMEWORKS=(["VLLM"]=1 ["TENSORRTLLM"]=2 ["SGLANG"]=3 ["VLLM_V1"]=4)
DEFAULT_FRAMEWORK=VLLM DEFAULT_FRAMEWORK=VLLM
SOURCE_DIR=$(dirname "$(readlink -f "$0")") SOURCE_DIR=$(dirname "$(readlink -f "$0")")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment