"examples/go-generate-streaming/main.go" did not exist on "4c7db6b7e917ef475a9d5dccd180cefd298175e4"
  • Daniel Hiltgen's avatar
    Move quantization to new backend (#10363) · 42481045
    Daniel Hiltgen authored
    * Move quantization logic to GGML via new backend
    
    This moves the model aware logic to Go code and calls GGMLs quantization code for model creation.
    
    * Remove "add model quantizations"
    
    This is no longer needed now that quantization is implemented in Go+GGML code directly.
    42481045
convert_llama_adapter.go 3.76 KB