Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
10fa9eea
Unverified
Commit
10fa9eea
authored
May 16, 2024
by
youkaichao
Committed by
GitHub
May 16, 2024
Browse files
[Misc] remove old comments (#4866)
parent
e0818808
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
10 deletions
+0
-10
vllm/worker/model_runner.py
vllm/worker/model_runner.py
+0
-10
No files found.
vllm/worker/model_runner.py
View file @
10fa9eea
...
...
@@ -887,16 +887,6 @@ class ModelRunner:
# This usually takes < 10 seconds.
logger
.
info
(
"Graph capturing finished in %.0f secs."
,
elapsed_time
)
def
__del__
(
self
)
->
None
:
# Delete the CUDA graphs before deleting the pynccl communicator.
# NOTE(woosuk): This is necessary because otherwise deadlocks can
# happen.
# FIXME(woosuk): This is a bit hacky. Find a more robust solution.
# TODO(youkaichao): when we get enough user feedback that pynccl is
# more stable than cupy, we can remove this, e.g. in v0.4.1.
self
.
graph_runners
.
clear
()
self
.
pynccl_backend
=
None
@
property
def
vocab_size
(
self
)
->
int
:
return
self
.
model_config
.
get_vocab_size
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment