Commits · 94e6b2d55f7fd539f01591c7521ec104b25f4e68 · OpenDAS / vllm_cscc

11 Sep, 2025 1 commit

Allow users to specify kv cache memory size (#21489) · 94e6b2d5

Boyuan Feng authored Sep 11, 2025

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

94e6b2d5

09 Sep, 2025 1 commit
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
06 Sep, 2025 2 commits
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
- [KV Sharing] Raise error if using eagle with fast prefill (#24350) · 3c529fc9
  Yong Hoon Shin authored Sep 05, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  3c529fc9
28 Aug, 2025 2 commits
- [V1] Enable prefill optimization for Gemma3n (#22628) · cb293f6a
  Yong Hoon Shin authored Aug 28, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  cb293f6a
- [Doc]: fix typos in Python scripts (#23828) · d3da2eea
  Didier Durand authored Aug 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d3da2eea
25 Aug, 2025 1 commit

[Doc: ]fix various typos in multiple files (#23487) · 47455c42

Didier Durand authored Aug 25, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

47455c42

15 Aug, 2025 1 commit

[V1] [Hybrid] Support using float32 for state in Hybrid Models (Mamba2, Mamba1, Minimax) (#22928) · 75531a6c

Thomas Parnell authored Aug 15, 2025


Signed-off-by: Daniel Afrimi <danielafrimi8@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Daniel Afrimi <danielafrimi8@gmail.com>
Co-authored-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

75531a6c

10 Aug, 2025 1 commit
- Move `CacheConfig` from `config/__init__.py` to `config/cache.py` (#22586) · 8290d15d
  Harry Mellor authored Aug 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8290d15d