Skip to content

GitLab

"examples/vscode:/vscode.git/clone" did not exist on "fac75e166b4a4a7f84ac5d12c3b8f4ba01cda57b"
Commit 77a66df7 authored by Jeffrey Morgan's avatar Jeffrey Morgan
Browse files

add macOS memory check for 47B models

parent 5b4837f8
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
llm/llm.go
View file @ 77a66df7
...@@ -51,6 +51,8 @@ func New(workDir, model string, adapters, projectors []string, opts api.Options) ...@@ -51,6 +51,8 @@ func New(workDir, model string, adapters, projectors []string, opts api.Options)
requiredMemory = 16 * format.GigaByte requiredMemory = 16 * format.GigaByte
case "30B", "34B", "40B": case "30B", "34B", "40B":
requiredMemory = 32 * format.GigaByte requiredMemory = 32 * format.GigaByte
case "47B":
requiredMemory = 48 * format.GigaByte
case "65B", "70B": case "65B", "70B":
requiredMemory = 64 * format.GigaByte requiredMemory = 64 * format.GigaByte
case "180B": case "180B":
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment