Commits · 4734704b30efff60feebf5f524ca9a3f5f8ac23a · OpenDAS / vllm_cscc · GitLab

25 Jun, 2025 15 commits
- static_scaled_fp8_quant should not run when scale.numel is not 1 (#20076) · 8b8c209e
  Eldar Kurtić authored Jun 25, 2025
  
  8b8c209e
- [Fix] Support cls pooling in ModernBertPooler (#20067) · 23a04e08
  lsz05 authored Jun 26, 2025
```
Signed-off-by: shengzhe.li <shengzhe.li@sbintuitions.co.jp>
```
  23a04e08
- [Quantization] Add compressed-tensors emulations support for NVFP4 (#19879) · 02c97d9a
  Dipika Sikka authored Jun 25, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  02c97d9a
- [Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723
  Nicolò Lucchesi authored Jun 25, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  e795d723
- [V1][Speculative Decoding] Fix DeepSeek MTP (#20022) · 8359f4c8
  cjackal authored Jun 26, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  8359f4c8
- [BugFix] Fix full-cuda-graph illegal memory access in FA3 (#20057) · 0f9e7354
  Lucas Wilkinson authored Jun 25, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  0f9e7354
- [Chore] debloat some initial logs (#19438) · ba7ba35c
  Aaron Pham authored Jun 25, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  ba7ba35c
- [Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward. Add... · 015fab8c
  bnellnm authored Jun 25, 2025
```
[Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward.  Add additional testing for cudagraphs. (#19717)
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  015fab8c
- [Feat][CLI] enforce-include-usage (#19695) · f59fc60f
  Max Wittig authored Jun 25, 2025
```
Signed-off-by: Max Wittig <max.wittig@siemens.com>
```
  f59fc60f
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- [Frontend] speed up import time of vllm.config (#18036) · 71089341
  David Xia authored Jun 25, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  71089341
- Move to a faster base64 implementation (#19984) · 3443aaf8
  h-avsha authored Jun 25, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  3443aaf8
- Revert "Fix(models/siglip): Add compatibility for Gemma models quantized by... · 2273ec32
  Isotr0py authored Jun 25, 2025
```
Revert "Fix(models/siglip): Add compatibility for Gemma models quantized by llm-compressor" (#20030)
```
  2273ec32
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
- [Llama4] Update `attn_temperature_tuning` (#19997) · 1afa9948
  Brayden Zhong authored Jun 24, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  1afa9948
24 Jun, 2025 8 commits
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
- [P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0
  lkchen authored Jun 24, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  91f7d9d0
- [BugFix] Fix multi-node offline data parallel (#19937) · 8619e715
  Nick Hill authored Jun 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8619e715
- [Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7
  d.transposed authored Jun 24, 2025
```
Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  c635c5f7
- [Fix][V1] Remove --scheduling-policy oracle (#20010) · 981eeca4
  amit authored Jun 24, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
```
  981eeca4
- [Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014) · 53da4cd3
  Li, Jiang authored Jun 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  53da4cd3
- [PERF] Speedup of MRoPE prepare inputs (#19939) · 9a3b8832
  Vadim Gimpelson authored Jun 24, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  9a3b8832
23 Jun, 2025 11 commits
- Feat Dynamic Quantization for MoE Layers in GPTQ Marlin Backend (#19395) · dd2ccf8d
  Jun-Howie authored Jun 24, 2025
  
  dd2ccf8d
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
- [Misc] Add type alias `ReqId` and `EngineId` for better readability (#19880) · d0132f02
  lkchen authored Jun 23, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d0132f02
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
- [EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885) · 68aaeb37
  Tyler Michael Smith authored Jun 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  68aaeb37
- [Doc] Update V1 status for decoder-only embedding models (#19952) · 5111642a
  Isotr0py authored Jun 23, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  5111642a
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [P/D][NixlConnector] Support `tp_size > num_kv_heads` deployments (#19691) · 2ebff5b7
  Nicolò Lucchesi authored Jun 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  2ebff5b7
- Fix(models/siglip): Add compatibility for Gemma models quantized by llm-compressor (#19643) · 493c2753
  Vensen authored Jun 23, 2025
```
Signed-off-by: Vensenmu <vensenmu@gmail.com>
```
  493c2753
- [Misc] Configurable timeout for execute_model RPC calls via env var (#19544) · f39ab2d4
  jinqinn authored Jun 23, 2025
```
Signed-off-by: jinqinn <goodqinjin@163.com>
```
  f39ab2d4
- [Core] feat: Implement Priority Scheduling in V1 Engine (#19057) · 4a0f7888
  amit authored Jun 23, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
Co-authored-by: Roger Wang <Rogerw0108@gmail.com>
```
  4a0f7888
22 Jun, 2025 6 commits
- [Perf][CLI] Improve overall startup time (#19941) · c4cf2606
  Aaron Pham authored Jun 22, 2025
  
  c4cf2606
- [BugFix] Add an env to disable moe chunking to work around compile incompatibility (#19642) · 33d51f59
  Ye (Charlotte) Qi authored Jun 22, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  33d51f59
- [Chore] dedup logs (#19955) · e91386cd
  Aaron Pham authored Jun 22, 2025
  
  e91386cd
- [Misc] Simplify vllm bench cli subcommand implementation (#19948) · 2c11a29f
  Ye (Charlotte) Qi authored Jun 22, 2025
  
  2c11a29f
- [Benchmark] fix request loss if "ping" is returned (#19535) · 202c5df9
  Wang, Yi authored Jun 22, 2025
```
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  202c5df9
- [MISC] add cpu_kvcache_space_bytes to CacheConfig (#19812) · 2bb246b8
  Ning Xie authored Jun 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2bb246b8