1. 18 Sep, 2025 1 commit
    • Patrick Devine's avatar
      convert: convert bf16 vision weights to fp16 (#12324) · 2717dce6
      Patrick Devine authored
      This change moves back to converting bf16 vision weights to fp16,
      specifically if they start with the name "v." (such as v.blk.0.attn_k.weight).
      
      This fixes a bug where converted images are failing because they are trying
      to call `im2col` which doesn't have a bf16 kernel in ggml.
      2717dce6
  2. 14 Aug, 2025 1 commit