Commits · cee182b2970b56d3f9d5aa0017ce165cbdb788f6 · OpenDAS / vllm_cscc

06 Sep, 2025 1 commit
- [Perf][V1] Fully overlap model execution (#23569) · cee182b2
  Benjamin Chislett authored Sep 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  cee182b2
05 Sep, 2025 2 commits
- [RFC] allow cancelation after shutdown in blocking collective_rpc (#23390) · 9dfbeb41
  Shiyan Deng authored Sep 05, 2025
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  9dfbeb41
- [XPU][P/D] Add XPU support in NixlConnector (#22436) · e599e2c6
  liuzhenwei authored Sep 05, 2025
```
Signed-off-by: zhenwei <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  e599e2c6
04 Sep, 2025 6 commits

[Misc] Have AsyncLLM `custom_stat_loggers` extend default logger list (#20952) · 60b755cb

Seiji Eicher authored Sep 04, 2025


Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Signed-off-by: Seiji Eicher <58963096+eicherseiji@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

60b755cb

[Doc]: fix typos in Python comments (#24173) · 83609ca9

Didier Durand authored Sep 04, 2025


Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

83609ca9

[Perf] Freeze core engine proc heap after init (#24008) · e41a0fa3
Nick Hill authored Sep 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
e41a0fa3
[XPU] support Triton Attention backend on Intel GPU (#24149) · 16ded21e
Kunshang Ji authored Sep 04, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
16ded21e

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

[Bugfix] Fix Incremental Detokenization with `tokenizers == 0.22.0` (#24159) · 2c301ee2

Fanli Lin authored Sep 04, 2025

Signed-off-by: Fanli Lin <fanli.lin@intel.com>
Signed-off-by: Fanli Lin <fanli0116@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2c301ee2

03 Sep, 2025 8 commits
- [Bugfix][DP] DP distribution does not require ray[default] (#23822) · a43a3f17
  Kebe authored Sep 04, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  a43a3f17
- [Attention] Blackwell FP8 MLA support with CUTLASS_MLA backend (#23289) · a7423220
  Matthew Bonanni authored Sep 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a7423220
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
- [Doc]: fix typos in Python comments (#24093) · d7e1e599
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d7e1e599
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
- [V1] Wrapper which plumbs request-level logits processors into vLLM... · 136d853e
  afeldman-nm authored Sep 02, 2025
```
[V1] Wrapper which plumbs request-level logits processors into vLLM batch-level logits processing (#23656)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  136d853e
- Upgrade xgrammar to 0.1.23 (#22988) · e32a0e86
  Russell Bryant authored Sep 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e32a0e86
02 Sep, 2025 4 commits
- [Log] Only Print Profiler Results on Rank 0 (#23370) · 98aee612
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  98aee612
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- Remove runtime checks based on pooling params (#24051) · d59c9864
  Maximilien de Bayser authored Sep 02, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  d59c9864
- [Doc]: fix typos in Python comments (#24042) · 0235103c
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0235103c
01 Sep, 2025 9 commits
- [bugfix]fix MTP hidden states (#24056) · a344a5aa
  Lucia Fang authored Sep 01, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  a344a5aa
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
- [Misc] Minor code simplification for spec decode (#24053) · 39a22dca
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  39a22dca
- [Doc]: fix typos in Python comments (#24026) · 10728495
  Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  10728495
- [Misc] add hash_function doc string (#24014) · 5438967f
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  5438967f
- [Misc] refactor code by import as for torch._inductor.config (#23677) · 499b074b
  Ning Xie authored Sep 01, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  499b074b
- [Misc] Move fast prefill logic to separate method (#24013) · b5571368
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b5571368
- [Misc] Avoid redundant copy for encoder-only models (#24012) · 8c742a66
  Woosuk Kwon authored Aug 31, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8c742a66
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
31 Aug, 2025 4 commits
- [Minor] Fix some random typos in comments (#24009) · 752d2e1c
  Nick Hill authored Aug 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  752d2e1c
- vllm fix check on max vocab size (#22471) · 81eea3d3
  Xiaodong Wang authored Aug 31, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  81eea3d3
- [Doc]: fix typos in Python comments (#24001) · 9701352e
  Didier Durand authored Aug 31, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  9701352e
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
30 Aug, 2025 4 commits
- [LoRA] Much faster startup when LoRA is enabled (#23777) · 038e9be4
  Andy Lo authored Aug 30, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  038e9be4
- [Refactor] refactor freezing_value/cuda_event initialize outside try finally (#23758) · e80bca30
  Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e80bca30
- [Misc] add reorder_batch AttentionMetadataBuilder (#23798) · fb4983e1
  Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  fb4983e1
- [Core] Cleanup TPU model runner for MM (#23894) · f1bddbd8
  Cyrus Leung authored Aug 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f1bddbd8
29 Aug, 2025 2 commits
- [BugFix] Async scheduling and PP compatibility with DP (#23770) · d90d8eb6
  Nick Hill authored Aug 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d90d8eb6
- Update PyTorch to 2.8.0 (#20358) · 67c14906
  Huy Do authored Aug 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  67c14906