Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "86a38aa3f09bd1a5f4b491c3d7d0cb377933d8d3"
Unverified Commit 562c0d52 authored by Casper's avatar Casper Committed by GitHub
Browse files

Remove simple dispatch

parent f8273a0c
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 3 deletions
awq/models/base.py
View file @ 562c0d52
......@@ -315,9 +315,6 @@ class BaseAWQForCausalLM(nn.Module):
if fuse_layers:
self.fuse_layers(model)
from awq.utils.utils import simple_dispatch_model
model = simple_dispatch_model(model, device_map)
else:
# If not quantized, must load with AutoModelForCausalLM
del model
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment