Commits · 2647163674720242cee78dae3f7c7b98539ed029 · OpenDAS / vllm_cscc · GitLab

04 Feb, 2026 6 commits
- Save startup benchmark results as a list of values (#33629) · 26471636
  Huy Do authored Feb 03, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  26471636
- [MM] Align the prefix of MMEncoderAttention with Attention (#33750) · 9fb27dd3
  Shanshan Shen authored Feb 04, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  9fb27dd3
- [CPU] Split attention dispatch by head_dim alignment (#32161) · 4dffc5e0
  R3hankhan authored Feb 04, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  4dffc5e0
- [1/N] Initial Implementation of Parser for ResponsesAPI (#32712) · e1bf04b6
  Andrew Xia authored Feb 03, 2026
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  e1bf04b6
- [Bugfix] Fix torchrun PP broadcast deadlock with async scheduling (#33701) · 02080179
  Isotr0py authored Feb 04, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  02080179
- [Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060) · 1b8fe6f7
  wang.yuqi authored Feb 04, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1b8fe6f7
03 Feb, 2026 34 commits
- [BugFix][Spec Decoding] Fix negative accepted tokens metric crash (#33729) · 52ee2102
  Nick Hill authored Feb 03, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  52ee2102
- [Dependency] Remove comments of ray in dependency files (#33351) · 655efb3e
  Wentao Ye authored Feb 03, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  655efb3e
- [Bugfix] Fix sparse MLA metadata building (#33579) · bd8da29a
  Matthew Bonanni authored Feb 03, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  bd8da29a
- [Bugfix] Disable TRTLLM FP8 MoE if router_logits_dtype==float32 and... · 2a99c5a6
  Michael Goin authored Feb 03, 2026
```
[Bugfix] Disable TRTLLM FP8 MoE if router_logits_dtype==float32 and routing_method!=DeepSeekV3 (#33613)
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  2a99c5a6
- [Voxtral Realtime] Change name (#33716) · 3f7662d6
  Patrick von Platen authored Feb 03, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3f7662d6
- [MISC] Fix Tensor Parallelism for Quantized Mamba Models with n_groups=1 (#33257) · a372f3f4
  Vadim Gimpelson authored Feb 04, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  a372f3f4
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
- [torch.compile] Significantly speed up cold start times (#33641) · b1bb18de
  Richard Zou authored Feb 03, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  b1bb18de
- [Attention][FA3] Update FA3 to include new swizzle optimization (#23465) · 2267cb1c
  Lucas Wilkinson authored Feb 03, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  2267cb1c
- [P/D] rework mooncake connector and introduce its bootstrap server (#31034) · 0d6ccf68
  dtc authored Feb 04, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  0d6ccf68
- [Bugfix] Fix startup hang for Granite Speech (#33699) · 18e7cbbb
  Cyrus Leung authored Feb 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  18e7cbbb
- [Voxtral models] Skip warm-up to skip confusing error message in warm-up (#33576) · f0d52517
  Patrick von Platen authored Feb 03, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f0d52517
- [MM] Pass `prefix` parameter to MMEncoderAttention (#33674) · 5c4f2dd6
  Shanshan Shen authored Feb 03, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  5c4f2dd6
- [Bugfix] Do not add extra \n for image-only cases when constructing multimodal... · f3d8a346
  wang.yuqi authored Feb 03, 2026
```
[Bugfix] Do not add extra \n for image-only cases when constructing multimodal text prompts. (#33647)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  f3d8a346
- Feat/add nemotron nano v3 tests (#33345) · 4bc913ae
  shaharmor98 authored Feb 03, 2026
  
  4bc913ae
- [Bugfix][Async][Connector] avoid vllm-side double free during async scheduling... · fbb3cf69
  Kuntai Du authored Feb 03, 2026
```
[Bugfix][Async][Connector] avoid vllm-side double free during async scheduling + request abort + async KV cache transfer (#33377)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  fbb3cf69
- Document NixlConnector backend selection via kv_connector_extra_config (#33552) · 2df2b349
  Krish Gupta authored Feb 03, 2026
```
Signed-off-by: KrxGu <krishom70@gmail.com>
```
  2df2b349
- Fix Gemma3n audio encoder for Transformers v5 (#33673) · 2a8d84e6
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2a8d84e6
- [Models] Intern-S1-Pro (#33636) · a3acfa10
  zxy authored Feb 03, 2026
```
Signed-off-by: zxy <zhou0493@e.ntu.edu.sg>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a3acfa10
- Fix Gemma3 GGUF for Transformers v5 (#33683) · be8168ff
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be8168ff
- Fix offline test for Transformers v5 (#33682) · f6af3462
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f6af3462
- [Bugfix] fix qwen3-asr response error (#33644) · ceab70c8
  Song Zhixin authored Feb 03, 2026
```
Signed-off-by: jesse <szxfml@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  ceab70c8
- [Misc] Update default image format of `encode_base64` (#33656) · 52683ccb
  Cyrus Leung authored Feb 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  52683ccb
- [Bugfix] Disable RoutingMethodType.[Renormalize,RenormalizeNaive] TRTLLM... · e346e2d0
  Michael Goin authored Feb 03, 2026
```
[Bugfix] Disable RoutingMethodType.[Renormalize,RenormalizeNaive] TRTLLM per-tensor FP8 MoE (#33620)
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e346e2d0
- [Refactor] Clean up pooling serial utils (#33665) · 83449a5f
  Cyrus Leung authored Feb 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83449a5f
- [Bugfix][Model] Fix DeepSeek-OCR-2 chat template to include BOS token (#33642) · dad2d6a5
  Lucas Hänke de Cansino authored Feb 03, 2026
```
Signed-off-by: l4b4r4b4b4 <lucas.cansino@mail.de>
```
  dad2d6a5
- [CI/Build] Investigate torchrun distributed tests hanging issue (#33650) · 32e84fa1
  Isotr0py authored Feb 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32e84fa1
- [torch.compile] Document the workaround to standalone_compile failing (#33571) · fd9c83d0
  Richard Zou authored Feb 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  fd9c83d0
- [Misc] Remove deprecated VLLM_ALL2ALL_BACKEND environment variable (#33535) · b95cc501
  杨朱 · Kiki authored Feb 03, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  b95cc501
- [Minor] Some code simplification in `scheduler.py` (#33597) · 61397891
  Nick Hill authored Feb 02, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  61397891
- [Misc] Remove deprecated profiler environment variables (#33536) · ef248ff7
  杨朱 · Kiki authored Feb 03, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  ef248ff7
- [XPU][1/N] Deprecate ipex and switch to vllm-xpu-kernels for xpu platform (#33379) · e1060448
  Kunshang Ji authored Feb 03, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  e1060448
- [Bugfix] Interleaved thinking keeps compatibility with reasoning_content (#33635) · bf001da4
  Chauncey authored Feb 03, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Koushik Dutta <koushd@gmail.com>
```
  bf001da4
- [CI/Build] Remove hardcoded America/Los_Angeles timezone from Dockerfiles (#33553) · a0a984ac
  杨朱 · Kiki authored Feb 03, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  a0a984ac