Commits · 5c538c37b26f8ebb9250dfc6a1866ec4aaac4299 · OpenDAS / vllm_cscc

12 Mar, 2025 1 commit

[V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due... · 5c538c37

Benjamin Chislett authored Mar 12, 2025


[V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing (#14645)
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>

5c538c37

16 Feb, 2025 1 commit
- [V1][Spec Decode] Ngram Spec Decode (#12193) · 80f63a39
  Lily Liu authored Feb 15, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  80f63a39