"vscode:/vscode.git/clone" did not exist on "bb4337b34c13fd704d8fd1afca30e22e1dbd9da7"
Unverified Commit e41312a2 authored by Christina Norman's avatar Christina Norman Committed by GitHub
Browse files

[Bugfix] Skip generation config fallback for GGUF to prevent multi-process hang (#30209)


Co-authored-by: default avatarClaude Opus 4.5 <noreply@anthropic.com>
parent 7b35011a
......@@ -954,6 +954,13 @@ def try_get_generation_config(
revision: str | None = None,
config_format: str | ConfigFormat = "auto",
) -> GenerationConfig | None:
# GGUF files don't have generation_config.json - their config is embedded
# in the file header. Skip all filesystem lookups to avoid re-reading the
# memory-mapped file, which can hang in multi-process scenarios when the
# EngineCore process already has the file mapped.
if is_gguf(model):
return None
try:
return GenerationConfig.from_pretrained(
model,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment