Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8a7368e0
Unverified
Commit
8a7368e0
authored
Apr 17, 2025
by
Jade Zheng
Committed by
GitHub
Apr 17, 2025
Browse files
[Misc] Remove redundant comment (#16703)
Signed-off-by:
Jade Zheng
<
zheng.shoujian@outlook.com
>
parent
93e561ec
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
3 deletions
+0
-3
vllm/v1/worker/gpu_model_runner.py
vllm/v1/worker/gpu_model_runner.py
+0
-3
No files found.
vllm/v1/worker/gpu_model_runner.py
View file @
8a7368e0
...
@@ -540,9 +540,6 @@ class GPUModelRunner(LoRAModelRunnerMixin):
...
@@ -540,9 +540,6 @@ class GPUModelRunner(LoRAModelRunnerMixin):
# because M (max_model_len) is not necessarily divisible by block_size.
# because M (max_model_len) is not necessarily divisible by block_size.
block_table_indices
=
(
req_indices
*
self
.
max_num_blocks_per_req
+
block_table_indices
=
(
req_indices
*
self
.
max_num_blocks_per_req
+
positions_np
//
self
.
block_size
)
positions_np
//
self
.
block_size
)
# NOTE(woosuk): We use torch.index_select instead of np.take here
# because torch.index_select is much faster than np.take for large
# tensors.
block_table_cpu
=
self
.
input_batch
.
block_table
.
get_cpu_tensor
()
block_table_cpu
=
self
.
input_batch
.
block_table
.
get_cpu_tensor
()
block_numbers
=
block_table_cpu
.
flatten
()[
block_table_indices
].
numpy
()
block_numbers
=
block_table_cpu
.
flatten
()[
block_table_indices
].
numpy
()
block_offsets
=
positions_np
%
self
.
block_size
block_offsets
=
positions_np
%
self
.
block_size
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment