Commits · 551ef1631a98d60fe9e82f0282e49c4a59a7887b · OpenDAS / vllm_cscc

"vllm/v1/executor/ray_utils.py" did not exist on "e38074b1e6ad0975acbfa15d858c4bd7cd005e99"

30 Jun, 2025 13 commits
- [Unit Test] Add unit test for deep gemm (#20090) · 551ef163
  Wentao Ye authored Jun 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  551ef163
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
- [Spec Decode] Clean up spec decode example (#20240) · 2965c99c
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2965c99c
- [Spec Decode] Refactor spec decoding into a separate function (#20238) · 2062c072
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2062c072
- [Bugfix] fix quark ptpc (#20251) · 1c50e100
  li haoyang authored Jun 30, 2025
```
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: Haoyang Li <307790822@qq.com>
```
  1c50e100
- [Docs] Fix 1-2-3 list in v1/prefix_caching.md (#20243) · 3ee56e26
  Michael Yao authored Jun 30, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  3ee56e26
- [Quantization] Improve BitsAndBytesModelLoader (#20242) · 8fe7fc86
  Jee Jee Li authored Jun 30, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8fe7fc86
- [Bugfix] Fix processor initialization in transformers 4.53.0 (#20244) · e936e401
  Isotr0py authored Jun 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  e936e401
- [Bugfix] Skip loading extra parameters for modelopt Qwen3 MoE model (#19598) · f5dfa075
  noiji authored Jun 30, 2025
```
Signed-off-by: noiji <>
```
  f5dfa075
- [doc] Add Slack and Forum to the top navigation (#20208) · 022c58b8
  Reid authored Jun 30, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  022c58b8
- [Misc] Fix import (#20233) · 19108ef3
  Woosuk Kwon authored Jun 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19108ef3
- [BUGFIX][DEEPSEEK][MODEL_LOAD] fix w13, w2 weight not initialized assert (#20202) · 5a52f389
  Chendi.Xue authored Jun 29, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  5a52f389
- [Model] support dots1 (#18254) · 65b1cbb1
  redmoe-moutain authored Jun 30, 2025
```
Signed-off-by: redmoe-moutain <agiredmoe@gmail.com>
```
  65b1cbb1
29 Jun, 2025 3 commits
- Fix cuda_archs_loose_intersection when handling sm_*a (#20207) · 6c9837a7
  Huy Do authored Jun 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  6c9837a7
- [Quantization] Add compressed-tensors NVFP4 MoE Support (#19990) · 6f2f53a8
  Dipika Sikka authored Jun 30, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  6f2f53a8
- [CI Fix] Try fixing eagle e2e test OOM by reducing block allocation (#20213) · 7b1895e6
  Michael Goin authored Jun 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7b1895e6
28 Jun, 2025 10 commits
- [Refactor] Create a function util and cache the results for `has_deepgemm`,... · 4d366936
  Wentao Ye authored Jun 28, 2025
```
[Refactor] Create a function util and cache the results for `has_deepgemm`, `has_deepep`, `has_pplx` (#20187)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4d366936
- [Bugfix] Correct behavior of GraniteMoeHybrid for TensorParallel execution (#20137) · daec9dea
  Stan Wozniak authored Jun 28, 2025
```
Signed-off-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  daec9dea
- [Frontend] Generalize `v1/audio/transcriptions` endpoint (#20179) · daceac57
  Nicolò Lucchesi authored Jun 28, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  daceac57
- [CI/Build] Add new CI job to validate Hybrid Models for every PR (#20147) · 8615d977
  Thomas Parnell authored Jun 28, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  8615d977
- [BugFix] Fix the incorrect func name in the comments. (config.py) (#20185) · 7b460c25
  Jiayi Yan authored Jun 28, 2025
  
  7b460c25
- [Bugfix] Properly reject requests with empty list guided_choice (#20195) · f7197722
  Michael Goin authored Jun 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f7197722
- fix ci issue distributed 4 gpu test (#20204) · d45417b8
  Wentao Ye authored Jun 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d45417b8
- Fix num_token_padding support for static per-tensor scaled_fp8_quant (#20188) · a29e62ea
  Michael Goin authored Jun 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a29e62ea
- [Misc] Add type assertion of request_id for LLMEngine.add_request (#19700) · e53be6f0
  Chales Xu authored Jun 28, 2025
```
Signed-off-by: n2ptr <xuzhanchaomail@163.com>
```
  e53be6f0
- [CI Fix] Pin tests/models/registry.py MiniMaxText01ForCausalLM to revision due... · c329ceca
  Michael Goin authored Jun 28, 2025
```
[CI Fix] Pin tests/models/registry.py MiniMaxText01ForCausalLM to revision due to model changes (#20199)
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c329ceca
27 Jun, 2025 14 commits

[CI/Build] Allow hermetic builds (#18064) · 3c545c0c

Fabien Dupont authored Jun 27, 2025


Signed-off-by: Fabien Dupont <fdupont@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Fabien Dupont <fabiendupont@pm.me>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Elias Levy <eliaslevy@google.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

3c545c0c

[Bugfix] Fix some narrowing conversion warnings (#20141) · e8c3bd2c
Tyler Michael Smith authored Jun 27, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
e8c3bd2c
[Bugfix] Mark 'hidden_states' as mutable in moe_forward registration. (#20152) · c6c98305
bnellnm authored Jun 27, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
c6c98305
[Fix][torch.compile] Enable custom ops by default when Inductor off (#20102) · aafabaa0
Luka Govedič authored Jun 27, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
aafabaa0
[Fix][ROCm] Remove unused variables to fix build error on GFX11/12 (#19891) · 94a55c76
Hosang authored Jun 27, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
94a55c76
[Perf] Improved perf for resolve_chat_template_content_format (#20065) · aa0dc77e
Ilya Lavrenov authored Jun 27, 2025
```
Signed-off-by: Ilya Lavrenov <ilya.lavrenov@cerebras.net>
```
aa0dc77e
[Bugfix] Fix flaky failure when getting DP ports (#20151) · 4ab3ac28
Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
4ab3ac28

Gemma3n (Text-only) (#20134) · d1c956dc

Robert Shaw authored Jun 27, 2025


Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>

d1c956dc

Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143) · dec197e3
Chendi.Xue authored Jun 27, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
dec197e3
[Perf][Frontend] eliminate api_key and x_request_id headers middleware overhead (#19946) · 6e244ae0
Yazan Sharaya authored Jun 27, 2025
```
Signed-off-by: Yazan-Sharaya <yazan.sharaya.yes@gmail.com>
```
6e244ae0
[Model][1/N] Automatic conversion of CrossEncoding model (#20012) · cd4cfee6
wang.yuqi authored Jun 27, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
cd4cfee6
[Fix] Fix gemma CI test failing on main (#20124) · e1109306
Thomas Parnell authored Jun 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
e1109306

[CI] Sync test dependency with test.in for torch nightly (#19632) · 8b64c895

Yang Wang authored Jun 26, 2025


Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

8b64c895

[Feature] add quick all reduce (#19744) · 0740e29b

li haoyang authored Jun 27, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>

0740e29b