• Bruce MacDonald's avatar
    improve api error handling (#781) · 6fe17813
    Bruce MacDonald authored
    - remove new lines from llama.cpp error messages relayed to client
    - check api option types and return error on wrong type
    - change num layers from 95% VRAM to 92% VRAM
    6fe17813
types.go 9.73 KB