Unverified Commit 53bf71b0 authored by Zuyi Zhao's avatar Zuyi Zhao Committed by GitHub
Browse files

[Misc] Update conftest for entrypoints/sagemaker test folder (#29799)


Signed-off-by: default avatarZuyi Zhao <zhaozuy@amazon.com>
parent f441d36c
......@@ -45,7 +45,10 @@ def basic_server_with_lora(smollm2_lora_files):
"64",
]
envs = {"VLLM_ALLOW_RUNTIME_LORA_UPDATING": "True"}
envs = {
"VLLM_ALLOW_RUNTIME_LORA_UPDATING": "True",
"SAGEMAKER_ENABLE_STATEFUL_SESSIONS": "True",
}
with RemoteOpenAIServer(MODEL_NAME_SMOLLM, args, env_dict=envs) as remote_server:
yield remote_server
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment