• Jesse Gross's avatar
    ollamarunner: Memory usage reporting · 73d6a82c
    Jesse Gross authored
    This provides granular information about the backend memory allocations
    required by the runner:
     - Per backend
     - Per layer
     - Weights, cache and graph
     - Allocation status
    
    This can be used for debugging and validating memory estimates.
    73d6a82c
causal_test.go 19.2 KB