Skip to content

GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "24bb4fe432fffeccf7a27270ee70aff1b1b8a89a"
Unverified Commit 695e7adc authored by 杨朱 · Kiki's avatar 杨朱 · Kiki Committed by GitHub
Browse files

[misc] Remove outdate comment about runai_model_streamer (#23421) 


Signed-off-by: default avatarcarlory <baofa.fan@daocloud.io>
parent 281710ef
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 3 deletions
vllm/model_executor/model_loader/weight_utils.py
View file @ 695e7adc
...@@ -31,9 +31,7 @@ from vllm.utils import PlaceholderModule ...@@ -31,9 +31,7 @@ from vllm.utils import PlaceholderModule
try: try:
from runai_model_streamer import SafetensorsStreamer from runai_model_streamer import SafetensorsStreamer
except (ImportError, OSError): except ImportError:
# see https://github.com/run-ai/runai-model-streamer/issues/26
# OSError will be raised on arm64 platform
runai_model_streamer = PlaceholderModule( runai_model_streamer = PlaceholderModule(
"runai_model_streamer") # type: ignore[assignment] "runai_model_streamer") # type: ignore[assignment]
SafetensorsStreamer = runai_model_streamer.placeholder_attr( SafetensorsStreamer = runai_model_streamer.placeholder_attr(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment