Skip to content

GitLab

"...text-generation-inference.git" did not exist on "5fca30ee15988a36951e9399eb6b41ba3775d6d3"
Unverified Commit ee8217e5 authored by amaleshvemula's avatar amaleshvemula Committed by GitHub
Browse files

Add Mistral to quantization model list (#1278)

parent 980dd4a2
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/model_executor/model_loader.py
View file @ ee8217e5
...@@ -35,6 +35,7 @@ _MODEL_REGISTRY = { ...@@ -35,6 +35,7 @@ _MODEL_REGISTRY = {
# FIXME(woosuk): Remove this once all models support quantization. # FIXME(woosuk): Remove this once all models support quantization.
_MODEL_CLASSES_SUPPORT_QUANTIZATION = [ _MODEL_CLASSES_SUPPORT_QUANTIZATION = [
LlamaForCausalLM, LlamaForCausalLM,
MistralForCausalLM,
] ]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment