Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
0a430b4a
Unverified
Commit
0a430b4a
authored
Apr 13, 2024
by
zspo
Committed by
GitHub
Apr 13, 2024
Browse files
[Bugfix] fix_small_bug_in_neuron_executor (#4051)
parent
ec8e3c69
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
0 deletions
+2
-0
vllm/executor/neuron_executor.py
vllm/executor/neuron_executor.py
+2
-0
No files found.
vllm/executor/neuron_executor.py
View file @
0a430b4a
...
...
@@ -25,6 +25,7 @@ class NeuronExecutor(ExecutorBase):
speculative_config
:
Optional
[
SpeculativeConfig
],
)
->
None
:
self
.
model_config
=
model_config
self
.
cache_config
=
cache_config
assert
lora_config
is
None
,
"LoRA is not supported for Neuron backend."
self
.
parallel_config
=
parallel_config
self
.
scheduler_config
=
scheduler_config
...
...
@@ -43,6 +44,7 @@ class NeuronExecutor(ExecutorBase):
self
.
parallel_config
,
self
.
scheduler_config
,
self
.
device_config
,
self
.
cache_config
,
)
self
.
driver_worker
.
init_device
()
self
.
driver_worker
.
load_model
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment