Skip to content

GitLab

Unverified Commit df5afa82 authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[Log] Debug Once for Randomizing dummy data for DP Rank (#22860) 


Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
parent 6cd69f51
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/worker/gpu_model_runner.py
View file @ df5afa82
...@@ -2192,7 +2192,7 @@ class GPUModelRunner(LoRAModelRunnerMixin, KVConnectorModelRunnerMixin): ...@@ -2192,7 +2192,7 @@ class GPUModelRunner(LoRAModelRunnerMixin, KVConnectorModelRunnerMixin):
high=self.model_config.get_vocab_size(), high=self.model_config.get_vocab_size(),
dtype=input_ids.dtype) dtype=input_ids.dtype)
logger.debug("Randomizing dummy data for DP Rank") logger.debug_once("Randomizing dummy data for DP Rank")
input_ids.copy_(rand_input_ids()[:input_ids.size(0)], input_ids.copy_(rand_input_ids()[:input_ids.size(0)],
non_blocking=True) non_blocking=True)
yield yield
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment