Skip to content

GitLab

Unverified Commit 562c0d52 authored by Casper's avatar Casper Committed by GitHub
Browse files

Remove simple dispatch

parent f8273a0c
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 3 deletions
awq/models/base.py
View file @ 562c0d52
......@@ -314,9 +314,6 @@ class BaseAWQForCausalLM(nn.Module):
if fuse_layers:
self.fuse_layers(model)
from awq.utils.utils import simple_dispatch_model
model = simple_dispatch_model(model, device_map)
else:
# If not quantized, must load with AutoModelForCausalLM
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment