• Jesse Gross's avatar
    ggml: Check for OOM and return as Go errors · a807985e
    Jesse Gross authored
    If there is a CUDA OOM, we currently don't check the return value
    and will evetually segfault. This checks for the problem and generates
    a Go error. At the moment, this will still result in a panic but having
    the error is the first step to being able to handle it more gracefully.
    a807985e
ggml.go 27.1 KB