Commits · 0df4d9b06b15fa39eeb2d440e7742da93afd5e6c · OpenDAS / vllm_cscc · GitLab

22 Jul, 2025 2 commits
- Update fp4 quantize API (#21327) · 9e23ad96
  Shu Wang authored Jul 22, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
  9e23ad96
- Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334) · e7b20426
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  e7b20426
21 Jul, 2025 3 commits
- [perf] Speed up align sum kernels (#21079) · 0ec82edd
  Himanshu Jaju authored Jul 21, 2025
```
Signed-off-by: Himanshu Jaju <hj@mistral.ai>
```
  0ec82edd
- Add Nvidia ModelOpt config adaptation (#19815) · 6b46c4b6
  Zhiyu authored Jul 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  6b46c4b6
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
19 Jul, 2025 5 commits
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
- [NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645) · 6d0734c5
  Kaixi Hou authored Jul 19, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  6d0734c5
- [Kernel][Performance] Tweak MoE Batched silu_mul_fp8_quant_deep_gemm kernel (#21193) · dcc6cfb9
  Varun Sundar Rabindranath authored Jul 19, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  dcc6cfb9
- [V0 Deprecation] Remove V0 Spec Decode workers (#21152) · dd572c0a
  Woosuk Kwon authored Jul 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dd572c0a
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
18 Jul, 2025 5 commits
- [Kernel] Apply torch.Tag.needs_fixed_stride_order only for torch==2.6.0 (#19346) · b2eb2b5a
  Richard Zou authored Jul 18, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  b2eb2b5a
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
- [Bugfix] Allocate less memory in non-batched CUTLASS MoE (#21121) · 4adc66f6
  ElizaWszola authored Jul 18, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  4adc66f6
- [Core] FlashInfer CUTLASS fused MoE backend (NVFP4) (#20037) · c7d8724e
  Shu Wang authored Jul 17, 2025
```
Signed-off-by: shuw <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c7d8724e
- [Log] Debugging Log with more Information (#20770) · 8a8fc946
  Wentao Ye authored Jul 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  8a8fc946
17 Jul, 2025 8 commits
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
- [Model] Update pooling model interface (#21058) · 90bd2ab6
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90bd2ab6
- [Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) · 9fb2d220
  ElizaWszola authored Jul 17, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  9fb2d220
- [Docs] Improve docstring formatting for `FusedMoEParallelConfig.make` (#21117) · fe8a2c54
  Harry Mellor authored Jul 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fe8a2c54
- [Model] Add ToolParser and MoE Config for Hunyuan A13B (#20820) · 5a7fb3ab
  Asher authored Jul 17, 2025
```
Signed-off-by: Asher Zhang <asherszhang@tencent.com>
```
  5a7fb3ab
- [Kernel] DeepGemm MoE : Integrate triton permute / unpermute kernels (#20903) · 11dfdf21
  Varun Sundar Rabindranath authored Jul 17, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  11dfdf21
- [Bugfix] Fix Machete zero point issue for GPTQ models on SM90 (#21066) · 28a6d542
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  28a6d542
- [Bugfix] weight loading use correct tp_group with patch_tensor_parallel_group (#21024) · c9ba8104
  Kevin_Xiong authored Jul 17, 2025
```
Signed-off-by: KevinXiong-C <kevin_xiong1997@outlook.com>
```
  c9ba8104
16 Jul, 2025 5 commits
- Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33
  Nir David authored Jul 16, 2025
```
Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>
```
  01513a33
- [Model] Consolidate pooler implementations (#20927) · 1c3198b6
  Cyrus Leung authored Jul 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1c3198b6
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Doc] Remove duplicate docstring (#21012) · 76ddeff2
  Wentao Ye authored Jul 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  76ddeff2
- [Bugfix] Correct per_act_token in CompressedTensorsW8A8Fp8MoECutlassM… (#20937) · fcb9f879
  Ming Yang authored Jul 15, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  fcb9f879
15 Jul, 2025 5 commits
- [BugFix] fix 3 issues: (1) using metadata for causal-conv1d, (2) indexing... · f29fd8a7
  Tuan, Hoang-Trong authored Jul 15, 2025
```
[BugFix] fix 3 issues: (1) using metadata for causal-conv1d, (2) indexing overflow in v1 vLLM, and (3) init_states in v0 (#20838)
Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
```
  f29fd8a7
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
- Enabled BnB NF4 inference on Gaudi (#20172) · 016b8d1b
  Ruheena Suhani Shaik authored Jul 15, 2025
```
Signed-off-by: Ruheena Suhani Shaik <rsshaik@habana.ai>
```
  016b8d1b
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
- [Bugfix] Fix incorrect dispatch for CutlassBlockScaledGroupedGemm and DeepGEMM (#20933) · bcdfb2a3
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bcdfb2a3
14 Jul, 2025 2 commits
- Fix overflow indexing in causal_conv1d kernel (#20938) · 86f3ac21
  Thomas Parnell authored Jul 14, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  86f3ac21
- [Misc] ModularKernel : Perform WeightAndReduce inside TritonExperts & DeepGemmExperts (#20725) · c0569dbc
  Varun Sundar Rabindranath authored Jul 15, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  c0569dbc
13 Jul, 2025 4 commits
- [V1] [ROCm] [AITER] Upgrade AITER to commit `916bf3c` and bugfix APIs (#20880) · 80d38b8a
  TJian authored Jul 13, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  80d38b8a
- [Refactor] Change the way of import triton (#20774) · c1acd6d7
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1acd6d7
- [Bugfix] Fix a couple PPLX+CUTLASS MoE bugs (#20825) · 3b3b778d
  ElizaWszola authored Jul 13, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  3b3b778d
- [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) · 42d440c2
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  42d440c2
12 Jul, 2025 1 commit
- [Bugfix] Restrict Machete to only run on Hopper (#20830) · 6e2c176e
  Michael Goin authored Jul 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6e2c176e