".github/vscode:/vscode.git/clone" did not exist on "4125d3a02b15faf4b19767a91797320151ce8bc6"
  • Patrick Devine's avatar
    convert: convert bf16 vision weights to fp16 (#12324) · 2717dce6
    Patrick Devine authored
    This change moves back to converting bf16 vision weights to fp16,
    specifically if they start with the name "v." (such as v.blk.0.attn_k.weight).
    
    This fixes a bug where converted images are failing because they are trying
    to call `im2col` which doesn't have a bf16 kernel in ggml.
    2717dce6
reader_test.go 8.85 KB