We wouldn't allocate any memory in multi-query (1 KV head). Fixes Starcoder et al.
Attach a file by drag & drop or click to upload
