Commits · 392edee34a008af2453d936cb3cdbd97842984a7 · OpenDAS / vllm_cscc · GitLab

26 Sep, 2025 6 commits
- EVS Support (Video tokens pruning) (#22980) · 392edee3
  Eugene Khvedchenya authored Sep 26, 2025
```
Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenya@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  392edee3
- [Misc] Remove unnecessary memoryviews in shm_broadcast.py (#25721) · 983056e4
  Nick Hill authored Sep 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  983056e4
- [Core] Force PIECEWISE CUDAGraph mode for encoder-decoder (#25701) · 13dd93c6
  Russell Bryant authored Sep 25, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  13dd93c6
- Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135) · 53a30845
  Aleksandr Malyshev authored Sep 25, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
```
  53a30845
- [Misc] Don't log shm dequeue delay warning on worker side (#25720) · 8b77328f
  Nick Hill authored Sep 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8b77328f
- [Refactor] Remove DeepGEMM OP Register (#25710) · 9fe4c2bd
  Wentao Ye authored Sep 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9fe4c2bd
25 Sep, 2025 34 commits
- Fix routing_bias dtype (#25711) · 081b5594
  Shu Wang authored Sep 25, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  081b5594
- [Model] rename NemotronH_Nano_VL -> NemotronH_Nano_VL_V2 (#25708) · 57329a8c
  tomeras91 authored Sep 26, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  57329a8c
- [Core] Enable command line logging for LLMEngine (#25610) · 8c435c9b
  Zhuohan Li authored Sep 25, 2025
```
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  8c435c9b
- [Spec Decode] Add Batch Parallel Ngram. Upto 8x lower overhead. (#24986) · e71b8e21
  Ekagra Ranjan authored Sep 25, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  e71b8e21
- [Optimization] Use a cheaper cache key in `get_model_architecture` (#25682) · 89fa54e6
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  89fa54e6
- [Optimization] Streamline `InputPreprocessor` (#25702) · 3d54bdcb
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3d54bdcb
- [V0 deprecation] Clean up LoRA (#25686) · 0fa673af
  Jee Jee Li authored Sep 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0fa673af
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
- [V0 deprecation] Clean up V0 fallback in compilation config (#25675) · 71b25b0d
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  71b25b0d
- [Model] Define `merge_by_field_config` MM interface (#25676) · 0ea80c87
  Cyrus Leung authored Sep 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0ea80c87
- [Model] Add optional parameter to reasoning parser constructor (#25554) · b8d9e4a3
  Tao Hui authored Sep 26, 2025
```
Signed-off-by: taohui <taohui3@gmail.com>
Signed-off-by: Tao Hui <taohui3@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  b8d9e4a3
- [BugFix] Fix DBO hang (#25625) · 13cc7f53
  Lucas Wilkinson authored Sep 25, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  13cc7f53
- Revert "[Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function`... · 916bd920
  Michael Goin authored Sep 25, 2025
```
Revert "[Bug] Dynamo Unsupported due to `BasevLLMParameter.torch_function` calling disabled super()" (#25681)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  916bd920
- [BUGFIX] Fix crash in Eagle Speculative Decoding models when exceedin… (#24662) · e04a1b6b
  AlonKejzman authored Sep 25, 2025
```
Signed-off-by: AlonKejzman <alonkeizman@gmail.com>
```
  e04a1b6b
- [Logging] Remove TORCH_NCCL_AVOID_RECORD_STREAMS to squash a warning (#25532) · 2e5df88c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  2e5df88c
- [Bugfix] Fix InternS1 video processing after Transformers v4.56 (#25644) · 03858e6d
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  03858e6d
- [ux] Switch a warning to debug about a pytorch fallback (#23750) · 532a6cfc
  Russell Bryant authored Sep 25, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  532a6cfc
- [CPU] update torch 2.8 and fix missing fields in TorchSDPAMetadata (#25652) · eb32335e
  Li, Jiang authored Sep 25, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  eb32335e
- [torch.compile] Make Query Quantization Fusable (#24914) · 69a8c8e9
  Jonas M. Kübler authored Sep 25, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  69a8c8e9
- [misc] log info messages by default for hanging / busy / idle (#25627) · 6c340da4
  youkaichao authored Sep 25, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6c340da4
- [mypy] Fix wrong type annotations related to tuple (#25660) · 2f171176
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f171176
- [Hardware][RISC-V] Add riscv64 support for vLLM with scalar (#22112) · 1e9a77e0
  chenlang authored Sep 25, 2025
```
Signed-off-by: chenlang <chen.lang5@zte.com.cn>
Co-authored-by: chenlang <10346245@zte.com.cn>
```
  1e9a77e0
- [XPU][Triton]add xpu config in triton_reshape_and_cache_flash (#25643) · d2af6744
  Kunshang Ji authored Sep 25, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  d2af6744
- Add backward compatibility for `guided_...` API (#25615) · 70fbdb26
  Harry Mellor authored Sep 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  70fbdb26
- [V0 deprecation] Remove unreachable model_config.supported_tasks (#25642) · 7f570f1c
  wang.yuqi authored Sep 25, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  7f570f1c
- [Bugfix] Parse SpeculativeConfig Error (#25142) · eaeca3cd
  yyzxw authored Sep 25, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  eaeca3cd
- [mypy] Further improve MM type annotations (#25654) · 12c1287d
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  12c1287d
- [Bugfix] Fix Qwen3-VL max_num_video_tokens calculation for video profiling (#25648) · 17b4c668
  Isotr0py authored Sep 25, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  17b4c668
- [Bugfix] Add triton.language.tensor placeholder (#25649) · 3c2b2cce
  Agata Dobrzyniewicz authored Sep 25, 2025
```
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
```
  3c2b2cce
- [Misc] Fix Qwen3-VL `video_grid_thw` typing (#25646) · 7be9ffcd
  Roger Wang authored Sep 25, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  7be9ffcd
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
- typo: remove duplicate `is` (#25641) · af4ee63e
  Nicole LiHui 🥜 authored Sep 25, 2025
```
Signed-off-by: nicole-lihui <nicole.li@daocloud.io>
```
  af4ee63e
- Map CwmForCausalLM to llama and LlamaForCausalLM (#25611) · bc092ea8
  Jacob Kahn authored Sep 25, 2025
```
Signed-off-by: Jacob Kahn <jacobkahn1@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  bc092ea8
- [Misc] Simplify PoolerOutput and move to `v1/outputs` (#25629) · 755ed7b0
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  755ed7b0