Skip to content

GitLab

Unverified Commit 4c409cab authored by Ning Xie's avatar Ning Xie Committed by GitHub
Browse files

[Misc] add vllm_config in __init__ (#19866) 


Signed-off-by: default avatarAndy Xie <andy.xning@gmail.com>
parent 3b1e4c6a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/worker/worker_base.py
View file @ 4c409cab
...@@ -509,6 +509,7 @@ class WorkerWrapperBase: ...@@ -509,6 +509,7 @@ class WorkerWrapperBase:
""" """
self.rpc_rank = rpc_rank self.rpc_rank = rpc_rank
self.worker: Optional[WorkerBase] = None self.worker: Optional[WorkerBase] = None
self.vllm_config: Optional[VllmConfig] = None
# do not store this `vllm_config`, `init_worker` will set the final # do not store this `vllm_config`, `init_worker` will set the final
# one. TODO: investigate if we can remove this field in # one. TODO: investigate if we can remove this field in
# `WorkerWrapperBase`, `init_cached_hf_modules` should be # `WorkerWrapperBase`, `init_cached_hf_modules` should be
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment