Unverified Commit 2f4a71da authored by HappyAmazonian's avatar HappyAmazonian Committed by GitHub
Browse files

[Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502)


Signed-off-by: default avatarShen Teng <sheteng@amazon.com>
Signed-off-by: default avatarHappyAmazonian <91216626+HappyAmazonian@users.noreply.github.com>
parent 69f8a0ea
...@@ -21,4 +21,4 @@ while IFS='=' read -r key value; do ...@@ -21,4 +21,4 @@ while IFS='=' read -r key value; do
done < <(env | grep "^${PREFIX}") done < <(env | grep "^${PREFIX}")
# Pass the collected arguments to the main entrypoint # Pass the collected arguments to the main entrypoint
exec vllm serve "${ARGS[@]}" exec standard-supervisor vllm serve "${ARGS[@]}"
\ No newline at end of file \ No newline at end of file
...@@ -49,7 +49,7 @@ ijson # Required for mistral streaming tool parser ...@@ -49,7 +49,7 @@ ijson # Required for mistral streaming tool parser
setproctitle # Used to set process names for better debugging and monitoring setproctitle # Used to set process names for better debugging and monitoring
openai-harmony >= 0.0.3 # Required for gpt-oss openai-harmony >= 0.0.3 # Required for gpt-oss
anthropic == 0.71.0 anthropic == 0.71.0
model-hosting-container-standards >= 0.1.10, < 1.0.0 model-hosting-container-standards >= 0.1.13, < 1.0.0
mcp mcp
grpcio>=1.76.0 grpcio>=1.76.0
grpcio-reflection>=1.76.0 grpcio-reflection>=1.76.0
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment