Skip to content

GitLab

"examples/vscode:/vscode.git/clone" did not exist on "aff9bc405a3a6f6a96689fb3a66ad185b8e48363"
Unverified Commit be8168ff authored by Harry Mellor's avatar Harry Mellor Committed by GitHub
Browse files

Fix Gemma3 GGUF for Transformers v5 (#33683) 


Signed-off-by: default avatarHarry Mellor <19981378+hmellor@users.noreply.github.com>
parent f6af3462
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/transformers_utils/gguf_utils.py
View file @ be8168ff
...@@ -250,7 +250,7 @@ def maybe_patch_hf_config_from_gguf( ...@@ -250,7 +250,7 @@ def maybe_patch_hf_config_from_gguf(
text_config = hf_config.get_text_config() text_config = hf_config.get_text_config()
is_gemma3 = hf_config.model_type in ("gemma3", "gemma3_text") is_gemma3 = hf_config.model_type in ("gemma3", "gemma3_text")
if vision_config is not None and is_gemma3: if vision_config is not None and is_gemma3:
new_hf_config = Gemma3Config.from_text_vision_configs( new_hf_config = Gemma3Config(
text_config=text_config, text_config=text_config,
vision_config=vision_config, vision_config=vision_config,
architectures=["Gemma3ForConditionalGeneration"], architectures=["Gemma3ForConditionalGeneration"],
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment