convert: quantize from safetensors needs kv (#10675)
When creating a quantized model from safetensors we need the array KV values to be loaded.Changing this value to -1 loads the KV values on the returned layer to be used and saved during quantization.
Showing
Please register or sign in to comment