Commits · e04a1b6b21e1c410abbd6fa87880d5aa0c4277c2 · OpenDAS / vllm_cscc

"examples/backends/sglang/deploy/disagg.yaml" did not exist on "ccc8c6270e2edea3c1051b07d10b663b5ba5d761"

25 Sep, 2025 27 commits
- [BUGFIX] Fix crash in Eagle Speculative Decoding models when exceedin… (#24662) · e04a1b6b
  AlonKejzman authored Sep 25, 2025
```
Signed-off-by: AlonKejzman <alonkeizman@gmail.com>
```
  e04a1b6b
- [Logging] Remove TORCH_NCCL_AVOID_RECORD_STREAMS to squash a warning (#25532) · 2e5df88c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  2e5df88c
- [Bugfix] Fix InternS1 video processing after Transformers v4.56 (#25644) · 03858e6d
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  03858e6d
- [ux] Switch a warning to debug about a pytorch fallback (#23750) · 532a6cfc
  Russell Bryant authored Sep 25, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  532a6cfc
- [CPU] update torch 2.8 and fix missing fields in TorchSDPAMetadata (#25652) · eb32335e
  Li, Jiang authored Sep 25, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  eb32335e
- [torch.compile] Make Query Quantization Fusable (#24914) · 69a8c8e9
  Jonas M. Kübler authored Sep 25, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  69a8c8e9
- [misc] log info messages by default for hanging / busy / idle (#25627) · 6c340da4
  youkaichao authored Sep 25, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6c340da4
- [mypy] Fix wrong type annotations related to tuple (#25660) · 2f171176
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f171176
- [Hardware][RISC-V] Add riscv64 support for vLLM with scalar (#22112) · 1e9a77e0
  chenlang authored Sep 25, 2025
```
Signed-off-by: chenlang <chen.lang5@zte.com.cn>
Co-authored-by: chenlang <10346245@zte.com.cn>
```
  1e9a77e0
- [XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643) · d2af6744
  Kunshang Ji authored Sep 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  d2af6744
- Add backward compatibility for `guided_...` API (#25615) · 70fbdb26
  Harry Mellor authored Sep 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  70fbdb26
- [V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
  wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  7f570f1c
- [Bugfix] Parse SpeculativeConfig Error (#25142) · eaeca3cd
  yyzxw authored Sep 25, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  eaeca3cd
- [mypy] Further improve MM type annotations (#25654) · 12c1287d
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12c1287d
- [Bugfix] Fix Qwen3-VL max_num_video_tokens calculation for video profiling (#25648) · 17b4c668
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  17b4c668
- [Bugfix] Add triton.language.tensor placeholder (#25649) · 3c2b2cce
  Agata Dobrzyniewicz authored Sep 25, 2025
```
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
```
  3c2b2cce
- [Misc] Fix Qwen3-VL `video_grid_thw` typing (#25646) · 7be9ffcd
  Roger Wang authored Sep 25, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  7be9ffcd
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
- typo: remove duplicate `is` (#25641) · af4ee63e
  Nicole LiHui 🥜 authored Sep 25, 2025
```
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
```
  af4ee63e
- Map CwmForCausalLM to llama and LlamaForCausalLM (#25611) · bc092ea8
  Jacob Kahn authored Sep 25, 2025
```
Signed-off-by: Jacob Kahn <jacobkahn1@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  bc092ea8
- [Misc] Simplify PoolerOutput and move to `v1/outputs` (#25629) · 755ed7b0
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  755ed7b0
- [Bugfix] fix apply_temperature to avoid nan in probs (#24734) · a676e668
  courage17340 authored Sep 25, 2025
```
Signed-off-by: courage17340 <courage17340@163.com>
```
  a676e668
- optimize: eliminate duplicate split_enc_dec_inputs calls (#25573) · c85be1f6
  Nicole LiHui 🥜 authored Sep 25, 2025
```
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
```
  c85be1f6
- [Model] Add LongCat-Flash (#23991) · 845adb3e
  XuruiYang authored Sep 25, 2025
```
Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>
```
  845adb3e
- Enable Fbgemm NVFP4 on Dense models (#25609) · 90b139cf
  Saman A. Pour authored Sep 24, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  90b139cf
- [Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling... · 4492e3a5
  Wentao Ye authored Sep 24, 2025
```
[Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling disabled super() (#25613)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  4492e3a5
- [Kernel] Support DCP for Triton backend (#25132) · 05c19485
  Wei Wei authored Sep 24, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  05c19485
24 Sep, 2025 13 commits
- [Model] Improve DotsOCRForCausalLM (#25466) · 52d0cb84
  Jee Jee Li authored Sep 25, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  52d0cb84
- Improve `--help` for enhanced user experience (#24903) · e7f27ea6
  Harry Mellor authored Sep 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e7f27ea6
- [Refactor] Use DeepGEMM Col Major TMA Aligned Tensor (#25517) · 1f291412
  Wentao Ye authored Sep 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1f291412
- feat: BF16 FlashInfer Fused Cutlass MOE for Hopper and Blackwell Expert Parallel (#25503) · 6160ba41
  Duncan Moss authored Sep 24, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  6160ba41
- [Logging] Improve log for when DeepEP HT disables CUDA Graphs (#25531) · fea80060
  Tyler Michael Smith authored Sep 24, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  fea80060
- [V0 Deprecation] Remove unused classes in attention (#25541) · e6750d0b
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  e6750d0b
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
- Suppress benign cuBLAS warning when capturing cudagraphs with DBO (#25596) · f84a472a
  Sage Moore authored Sep 24, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  f84a472a
- Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72
  Shu Wang authored Sep 24, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  54e42b72
- [Bugfix] add cache model when from object storage get model (#24764) · 2dda3e35
  rongfu.leng authored Sep 25, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  2dda3e35
- [ROCm][Bugfix] Only enable +rms_norm based on aiter if not explicitly disabled (#25275) · 487745ff
  Gregory Shtrasberg authored Sep 24, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  487745ff
- [Misc] Improve type annotations for jsontree (#25577) · 9313be50
  Cyrus Leung authored Sep 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9313be50
- Move `DeviceConfig`, `ObservabilityConfig`, `SpeechToTextConfig` to their own files (#25564) · 8938774c
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8938774c