Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
b568df5d
Unverified
Commit
b568df5d
authored
Aug 09, 2024
by
Yineng Zhang
Committed by
GitHub
Aug 09, 2024
Browse files
fix: resolve correctness_test issue (#1002)
parent
10bca45b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
python/sglang/bench_latency.py
python/sglang/bench_latency.py
+1
-1
No files found.
python/sglang/bench_latency.py
View file @
b568df5d
...
...
@@ -238,7 +238,7 @@ def correctness_test(
# Decode
output_ids
=
[
input_ids
[
i
]
+
[
next_token_ids
[
i
]]
for
i
in
range
(
len
(
input_ids
))]
for
_
in
range
(
bench_args
.
output_len
):
for
_
in
range
(
bench_args
.
output_len
[
0
]
):
next_token_ids
,
_
=
decode
(
next_token_ids
,
batch
,
model_runner
)
for
i
in
range
(
len
(
reqs
)):
output_ids
[
i
].
append
(
next_token_ids
[
i
])
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment