Unverified Commit 2f4a71da authored by HappyAmazonian's avatar HappyAmazonian Committed by GitHub
Browse files

[Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502)


Signed-off-by: default avatarShen Teng <sheteng@amazon.com>
Signed-off-by: default avatarHappyAmazonian <91216626+HappyAmazonian@users.noreply.github.com>
parent 69f8a0ea
......@@ -21,4 +21,4 @@ while IFS='=' read -r key value; do
done < <(env | grep "^${PREFIX}")
# Pass the collected arguments to the main entrypoint
exec vllm serve "${ARGS[@]}"
\ No newline at end of file
exec standard-supervisor vllm serve "${ARGS[@]}"
\ No newline at end of file
......@@ -49,7 +49,7 @@ ijson # Required for mistral streaming tool parser
setproctitle # Used to set process names for better debugging and monitoring
openai-harmony >= 0.0.3 # Required for gpt-oss
anthropic == 0.71.0
model-hosting-container-standards >= 0.1.10, < 1.0.0
model-hosting-container-standards >= 0.1.13, < 1.0.0
mcp
grpcio>=1.76.0
grpcio-reflection>=1.76.0
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment