Commits · e9fd658a736a4d30f7a367c317506c87ad7f5359 · OpenDAS / vllm_cscc · GitLab

26 Jun, 2025 8 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [Refactor] Rename commnication utils (#20091) · 56230881
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  56230881
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
- [Bug Fix] Fix address/port already in use error for deep_ep test (#20094) · c894c5dc
  Wentao Ye authored Jun 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c894c5dc
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
- [Bugfix] Allow `CUDA_VISIBLE_DEVICES=''` in `Platform.device_id_to_physical_device_id` (#18979) · 65397e40
  Seiji Eicher authored Jun 26, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  65397e40
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835
- [Bugfix] Fix Mistral tool-parser regex for nested JSON (#20093) · 754b00ed
  Michael Goin authored Jun 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  754b00ed
25 Jun, 2025 7 commits
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
- [Misc] Add parallel state `node_count` function (#20045) · c40692bf
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c40692bf
- [PD] let toy proxy handle /chat/completions (#19730) · 4734704b
  lkchen authored Jun 25, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  4734704b
- [Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723
  Nicolò Lucchesi authored Jun 25, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  e795d723
- [Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward. Add... · 015fab8c
  bnellnm authored Jun 25, 2025
```
[Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward.  Add additional testing for cudagraphs. (#19717)
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  015fab8c
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
24 Jun, 2025 5 commits
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
- [P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0
  lkchen authored Jun 24, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  91f7d9d0
- [Fix][V1] Remove --scheduling-policy oracle (#20010) · 981eeca4
  amit authored Jun 24, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
```
  981eeca4
- [Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014) · 53da4cd3
  Li, Jiang authored Jun 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  53da4cd3
23 Jun, 2025 7 commits
- [TPU] Fix tpu model runner test (#19995) · 33d5e29b
  Chenyaaang authored Jun 23, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  33d5e29b
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
- [EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885) · 68aaeb37
  Tyler Michael Smith authored Jun 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  68aaeb37
- [Bugfix] Fix CI bitsandbytes failure (#19969) · a6e6604d
  Jee Jee Li authored Jun 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a6e6604d
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [Core] feat: Implement Priority Scheduling in V1 Engine (#19057) · 4a0f7888
  amit authored Jun 23, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
Co-authored-by: Roger Wang <Rogerw0108@gmail.com>
```
  4a0f7888
21 Jun, 2025 1 commit
- [New model support]Support Tarsier2 (#19887) · c3bf9bad
  汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  c3bf9bad
20 Jun, 2025 6 commits
- [CPU][CI] Fallback sliding window to v0 and fix CPU pooling model tests (#19901) · 79f2f1c2
  Li, Jiang authored Jun 20, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  79f2f1c2
- Export NaNs in logits to scheduler_stats if output is corrupted (#18777) · 2e3e3c86
  Vlad Tiberiu Mihailescu authored Jun 20, 2025
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  2e3e3c86
- [custom_op][vllm-plugin] update custom_op class to use op_registry (#19164) · 7e8977fc
  Chendi.Xue authored Jun 20, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  7e8977fc
- [Model] GPT2ForSequenceClassification model (#19663) · f1e840e8
  Adrian authored Jun 20, 2025
```
Signed-off-by: nie3e <adrcwiek@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f1e840e8
- [Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583) · 5e666f72
  kourosh hakhamaneshi authored Jun 19, 2025
  
  5e666f72
- [CI/Build][Bugfix] Fix deadlock on v1 engine test CI (#19872) · ee9a1531
  Isotr0py authored Jun 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ee9a1531
19 Jun, 2025 6 commits
- [Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
  Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  ead21102
- Fixing Chunked Prefill Test. (#19762) · 47194606
  Alexei-V-Ivanov-AMD authored Jun 19, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  47194606
- Add xLAM tool parser support (#17148) · 1d0ae26c
  Zuxin authored Jun 18, 2025
  
  1d0ae26c
- [Minor] Allow redirecting model path for HfRunner in test (#19795) · 60219995
  Isotr0py authored Jun 19, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  60219995
- Mark invariant normalizer in Gemma as non-persistent (#19788) · 83ca9ae4
  Yu-Hang "Maxin" Tang authored Jun 18, 2025
```
Signed-off-by: Yu-Hang Tang <Tang.Maxin@gmail.com>
```
  83ca9ae4
- [Bugfix] Add check_health to v1 async client. (#19821) · e2148dc5
  kourosh hakhamaneshi authored Jun 18, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  e2148dc5