Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
5208b291
Commit
5208b291
authored
Dec 30, 2025
by
jujl1
Browse files
fix: 解决列表访问越界
parent
bc945a5a
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
0 deletions
+3
-0
vllm/zero_overhead/v1/core.py
vllm/zero_overhead/v1/core.py
+2
-0
vllm/zero_overhead/v1/gpu_model_runner.py
vllm/zero_overhead/v1/gpu_model_runner.py
+1
-0
No files found.
vllm/zero_overhead/v1/core.py
View file @
5208b291
...
...
@@ -72,6 +72,8 @@ def zero_overhead_update_from_output(scheduler:Scheduler,
continue
request
=
scheduler
.
requests
[
req_id
]
generated_token_ids
=
model_runner_output
.
fix_sampled_token_ids
[
req_idx
]
if
not
generated_token_ids
:
continue
if
req_id
not
in
requsets_valid_token_len
:
requsets_valid_token_len
[
req_id
]
=
0
valid_output_len
=
requsets_valid_token_len
[
req_id
]
...
...
vllm/zero_overhead/v1/gpu_model_runner.py
View file @
5208b291
...
...
@@ -705,6 +705,7 @@ class V1ZeroModelRunner(GPUModelRunner):
self
.
fix_sampled_token_ids
=
self
.
last_sampler_host_tokens
.
tolist
()
for
req_idx
,
start_idx
,
end_idx
in
self
.
token_ids_cpu_fix_record
:
if
start_idx
==
-
1
:
self
.
fix_sampled_token_ids
[
req_idx
].
clear
()
continue
req_id
=
self
.
fix_req_ids
[
req_idx
]
if
req_id
in
self
.
input_batch
.
req_ids
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment