Skip to content

GitLab

Commit 475481b4 authored by Casper's avatar Casper
Browse files

Support Falcon 180B

parent 9304af95
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
awq/models/auto.py
View file @ 475481b4
...@@ -8,6 +8,7 @@ AWQ_CAUSAL_LM_MODEL_MAP = { ...@@ -8,6 +8,7 @@ AWQ_CAUSAL_LM_MODEL_MAP = {
"opt": OptAWQForCausalLM, "opt": OptAWQForCausalLM,
"RefinedWeb": FalconAWQForCausalLM, "RefinedWeb": FalconAWQForCausalLM,
"RefinedWebModel": FalconAWQForCausalLM, "RefinedWebModel": FalconAWQForCausalLM,
"falcon": FalconAWQForCausalLM,
"bloom": BloomAWQForCausalLM, "bloom": BloomAWQForCausalLM,
"gptj": GPTJAWQForCausalLM "gptj": GPTJAWQForCausalLM
} }
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment