Skip to content

GitLab

"...text-generation-inference.git" did not exist on "cece8635f8ec9b89cabef2f056c07ec8de3b00d1"
Unverified Commit ab9e8488 authored by forpanyang's avatar forpanyang Committed by GitHub
Browse files

Add Yi model to quantization support (#1600)

parent fd58b73a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/model_executor/model_loader.py
View file @ ab9e8488
...@@ -41,6 +41,7 @@ _MODEL_REGISTRY = { ...@@ -41,6 +41,7 @@ _MODEL_REGISTRY = {
_MODEL_CLASSES_SUPPORT_QUANTIZATION = [ _MODEL_CLASSES_SUPPORT_QUANTIZATION = [
LlamaForCausalLM, LlamaForCausalLM,
MistralForCausalLM, MistralForCausalLM,
YiForCausalLM,
] ]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment