Add missing BF16 tensor type. (#7193)

Co-authored-by: Richard Lyons <frob@cloudstaff.com>

Add missing BF16 tensor type. (#7193)
Co-authored-by: Richard Lyons <frob@cloudstaff.com>
09035b71 · frob · GitHub · f3c8b898 · 09035b71
Unverified Commit 09035b71 authored Oct 15, 2024 by frob Committed by GitHub Oct 14, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 0 deletions

llm/ggml.go llm/ggml.go +2 -0

No files found.
--- a/llm/ggml.go
+++ b/llm/ggml.go
@@ -244,6 +244,8 @@ func (t Tensor) typeSize() uint64 {
 		return 8
 	case 29: // IQ1_M
 		return blockSize/8 + blockSize/16 + blockSize/32
+	case 30: // BF16
+		return 2
 	default:
 		return 0
 	}