kvcache: Log batch size if we can't find a slot
In some cases, we can't find a cache slot when using sliding window attention. It would be helpful in this (and other cases) to know what the batch size is. Bug #10127
Showing
Please register or sign in to comment