Commits · 58eee5f2e05b74eb2cb1a3bbda9c04df4805e4cc · OpenDAS / vllm_cscc

02 Aug, 2025 6 commits
- [Bugfix] Mamba2 remove bugged initial state condition in chunk scan (#22034) · c64861d6
  Chih-Chieh Yang authored Aug 02, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
  c64861d6
- [FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL... · d3a6f212
  vllmellm authored Aug 02, 2025
```
[FEAT][ROCm] Enable running Flash Attention as ViT attn backend for Qwen-VL models on ROCm platform. (#22069)
Signed-off-by: tjtanaavllm <tunjian.tan@amd.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: tjtanaavllm <tunjian.tan@amd.com>
```
  d3a6f212
- [Speculators][Speculative Decoding] Add Qwen Eagle3 Support (#21835) · 9f9c38c3
  Dipika Sikka authored Aug 01, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  9f9c38c3
- [Misc] DeepGemmExperts : Avoid JIT generation in the hot-path (#21955) · a65f46be
  Varun Sundar Rabindranath authored Aug 02, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  a65f46be
- [Model] Qwen2.5 VL SiLU-and-Mul (#22066) · ee2eb6ec
  vllmellm authored Aug 02, 2025
```
Signed-off-by: kf <kuanfu.liu@embeddedllm.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: kf <kuanfu.liu@embeddedllm.com>
```
  ee2eb6ec
- feat: Add Support GPTQ Quantization MOE on ROCM vllm serve (#21733) · 3654847d
  JartX authored Aug 02, 2025
  
  3654847d
01 Aug, 2025 9 commits
- Enable headless models for pooling in the Transformers backend (#21767) · 38c8bce8
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  38c8bce8
- [Bugfix] [Performance] DeepEPHighThroughput + DeepSeek : Quant before Dispatch (#21837) · ac45c44d
  Varun Sundar Rabindranath authored Aug 01, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  ac45c44d
- [Bugfix] Fix glm4.1v video inference issue (#22067) · 3f8e9521
  Isotr0py authored Aug 02, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  3f8e9521
- [Speculative Decoding] Add `speculators` config support (#21345) · dfbc1f88
  Dipika Sikka authored Aug 01, 2025
  
  dfbc1f88
- Revert "Update sampling_metadata.py (#21937)" (#22088) · 87c94bc8
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  87c94bc8
- [Quantization] Enable BNB support for InternS1 (#21953) · 28b18cc7
  Jee Jee Li authored Aug 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  28b18cc7
- Update sampling_metadata.py (#21937) · 53d7c392
  Aviad Rossmann authored Aug 01, 2025
```
Signed-off-by: Aviad Rossmann <aviadr@neureality.ai>
```
  53d7c392
- [Model] [Quantization] Support quantization for Gemma3n (#21974) · 0f46a780
  Kyle Sayers authored Aug 01, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  0f46a780
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
31 Jul, 2025 8 commits
- [Feature] Add Flashinfer MoE Support for Compressed Tensor NVFP4 (#21639) · c3e0e933
  Wentao Ye authored Jul 31, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c3e0e933
- [Bugfix] Fix MTP weight loading (#21941) · 2dff2e21
  Benjamin Chislett authored Jul 31, 2025
  
  2dff2e21
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- [Model] Add step3 vl (#21998) · 94846416
  Song authored Jul 31, 2025
```
Signed-off-by: oliveryuan <yuansong@step.ai>
Co-authored-by: oliveryuan <yuansong@step.ai>
```
  94846416
- [NVIDIA] Add SM100 Flashinfer MoE per tensor scale fp8 backend (#21458) · 207b750e
  amirkl94 authored Jul 31, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  207b750e
- [Model][CI] Let more pooling models support v1 (#21747) · 2836dd73
  wang.yuqi authored Jul 31, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  2836dd73
- [Misc] Expand SUPPORTED_HIDDEN_SIZES for DeepEP low-latency kernels (#21818) · 0f7919fc
  Jee Jee Li authored Jul 31, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0f7919fc
- [Bugfix] Relax lang pin for voxtral (#21833) · ec02e536
  Sanchit Gandhi authored Jul 31, 2025
```
Signed-off-by: Sanchit Gandhi <sgandhi3141@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ec02e536
30 Jul, 2025 8 commits
- [CI/Build] Fix registry tests (#21934) · 004203e9
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  004203e9
- Override attention metadata for fast prefill in some KV sharing setups (#21590) · ad510309
  Yong Hoon Shin authored Jul 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  ad510309
- [Bugfix] Fix OOM tests in initialization test (#21921) · 6e599eeb
  Isotr0py authored Jul 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  6e599eeb
- [NVIDIA] Fix Llama4 Scout FP4 functionality issues (#21499) · ff08e519
  Po-Han Huang (NVIDIA) authored Jul 30, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  ff08e519
- [Feature][EPLB] Add eplb support for Qwen3 (#20815) · d979dd6b
  aladerran authored Jul 30, 2025
```
Signed-off-by: aladerran <aladerran@gmail.com>
```
  d979dd6b
- [Model] Remove DSV2 unused code (#21903) · fc91da54
  Jee Jee Li authored Jul 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fc91da54
- [Misc] Remove redundant config definitions (#21891) · 2ca5f82c
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2ca5f82c
- [Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with... · fdde1822
  Areeb Syed authored Jul 30, 2025
```
[Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with BitsAndBytes quantization (#21808)
Signed-off-by: sydarb <areebsyed237@gmail.com>
```
  fdde1822
29 Jul, 2025 7 commits
- [BugFix] Fix interleaved sliding window not set for Gemma3n (#21863) · 9266d980
  Yong Hoon Shin authored Jul 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  9266d980
- [Bugfix]fix mixed bits and visual language model quantization in AutoRound (#21802) · ad341c51
  Wenhua Cheng authored Jul 29, 2025
```
Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
```
  ad341c51
- [Model] Refactor JambaForCausalLM (#21394) · 61a6905a
  Jee Jee Li authored Jul 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  61a6905a
- [V0 deprecation] Guided decoding (#21347) · 37efc63b
  Reza Barazesh authored Jul 29, 2025
```
Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  37efc63b
- [Model]: Fused MoE for nomic-embed-text-v2-moe (#18321) · a4528f0c
  Isotr0py authored Jul 29, 2025
```
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a4528f0c
- Migrate InternVLImageInputs and InternVLVideoInputs to TensorSchema (#21684) · f1e2c095
  Benji Beck authored Jul 28, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  f1e2c095
- [Refactor] Merge Compressed Tensor FP8 `CompressedTensorsW8A8Fp8MoEMethod` and... · 48b763d6
  Wentao Ye authored Jul 28, 2025
```
[Refactor] Merge Compressed Tensor FP8 `CompressedTensorsW8A8Fp8MoEMethod` and `CompressedTensorsW8A8Fp8MoECutlassMethod` (#21775)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  48b763d6
28 Jul, 2025 2 commits

[Feat]: Add support for Dynamic Quant 4 bit CPU kleidiai kernels (#17112) · 89ac266b
Nikhil Gupta authored Jul 28, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
89ac266b

[AMD][BugFix] Fix omission of wvSplitK kernel for small batch sizes (1-4) due... · b361f14e

rasmith authored Jul 28, 2025


[AMD][BugFix] Fix omission  of wvSplitK kernel for small batch sizes (1-4) due to torch.compile (#21350)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

b361f14e