Commits · c40692bf9adc77cde0c802c6c586b7cf143c39c2 · OpenDAS / vllm_cscc · GitLab

25 Jun, 2025 6 commits
- [Misc] Add parallel state `node_count` function (#20045) · c40692bf
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c40692bf
- [PD] let toy proxy handle /chat/completions (#19730) · 4734704b
  lkchen authored Jun 25, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  4734704b
- [Frontend] Add `/v1/audio/translations` OpenAI API endpoint (#19615) · e795d723
  Nicolò Lucchesi authored Jun 25, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  e795d723
- [Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward. Add... · 015fab8c
  bnellnm authored Jun 25, 2025
```
[Kernels][Bugfix] Use torch op for all kernels in FusedMoE forward.  Add additional testing for cudagraphs. (#19717)
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  015fab8c
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
24 Jun, 2025 5 commits
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
- [P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0
  lkchen authored Jun 24, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  91f7d9d0
- [Fix][V1] Remove --scheduling-policy oracle (#20010) · 981eeca4
  amit authored Jun 24, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
```
  981eeca4
- [Bugfix][CPU] Fix InputBatch for pooling models in the CPU v1 (#20014) · 53da4cd3
  Li, Jiang authored Jun 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  53da4cd3
23 Jun, 2025 7 commits
- [TPU] Fix tpu model runner test (#19995) · 33d5e29b
  Chenyaaang authored Jun 23, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  33d5e29b
- [Feature] Support sequence parallelism for static fp8 quantization (#19181) · e6327c9b
  cascade authored Jun 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  e6327c9b
- [Bugfix][v1] Fix step pooler implementation and step pooling usage in v1 (#19956) · 61f4fc5d
  Isotr0py authored Jun 24, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  61f4fc5d
- [EP+DP] Optimize the little operations in the DeepGEMM + DeepEP low latency case (#19885) · 68aaeb37
  Tyler Michael Smith authored Jun 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  68aaeb37
- [Bugfix] Fix CI bitsandbytes failure (#19969) · a6e6604d
  Jee Jee Li authored Jun 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a6e6604d
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [Core] feat: Implement Priority Scheduling in V1 Engine (#19057) · 4a0f7888
  amit authored Jun 23, 2025
```
Signed-off-by: amit <amit.man@gmail.com>
Co-authored-by: Roger Wang <Rogerw0108@gmail.com>
```
  4a0f7888
21 Jun, 2025 1 commit
- [New model support]Support Tarsier2 (#19887) · c3bf9bad
  汪志鹏 authored Jun 21, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  c3bf9bad
20 Jun, 2025 6 commits
- [CPU][CI] Fallback sliding window to v0 and fix CPU pooling model tests (#19901) · 79f2f1c2
  Li, Jiang authored Jun 20, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  79f2f1c2
- Export NaNs in logits to scheduler_stats if output is corrupted (#18777) · 2e3e3c86
  Vlad Tiberiu Mihailescu authored Jun 20, 2025
```
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
```
  2e3e3c86
- [custom_op][vllm-plugin] update custom_op class to use op_registry (#19164) · 7e8977fc
  Chendi.Xue authored Jun 20, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  7e8977fc
- [Model] GPT2ForSequenceClassification model (#19663) · f1e840e8
  Adrian authored Jun 20, 2025
```
Signed-off-by: nie3e <adrcwiek@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f1e840e8
- [Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583) · 5e666f72
  kourosh hakhamaneshi authored Jun 19, 2025
  
  5e666f72
- [CI/Build][Bugfix] Fix deadlock on v1 engine test CI (#19872) · ee9a1531
  Isotr0py authored Jun 20, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ee9a1531
19 Jun, 2025 8 commits
- [Core][Bugfix] Fix Online MM Beam Search (#19688) · ead21102
  Alex Brooks authored Jun 19, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  ead21102
- Fixing Chunked Prefill Test. (#19762) · 47194606
  Alexei-V-Ivanov-AMD authored Jun 19, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  47194606
- Add xLAM tool parser support (#17148) · 1d0ae26c
  Zuxin authored Jun 18, 2025
  
  1d0ae26c
- [Minor] Allow redirecting model path for HfRunner in test (#19795) · 60219995
  Isotr0py authored Jun 19, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  60219995
- Mark invariant normalizer in Gemma as non-persistent (#19788) · 83ca9ae4
  Yu-Hang "Maxin" Tang authored Jun 18, 2025
```
Signed-off-by: Yu-Hang Tang <Tang.Maxin@gmail.com>
```
  83ca9ae4
- [Bugfix] Add check_health to v1 async client. (#19821) · e2148dc5
  kourosh hakhamaneshi authored Jun 18, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  e2148dc5
- Support embedding models in V1 (#16188) · 799397ee
  Maximilien de Bayser authored Jun 19, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  799397ee
- [BugFix] Fix use_cudagraph=False (#19612) · ed333497
  Richard Zou authored Jun 18, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ed333497
18 Jun, 2025 3 commits
- [Core] Do not copy array during hashing (#19484) · 3b523e38
  Lukas Geiger authored Jun 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3b523e38
- [v1] Support mamba2 (#19327) · a89209b7
  Chen Zhang authored Jun 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  a89209b7
- [Misc] Add __str__ for RequestStatus (#19780) · d4629dc4
  lkchen authored Jun 17, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d4629dc4
17 Jun, 2025 4 commits
- [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) · a44b1c95
  Charlie Fu authored Jun 17, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  a44b1c95
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
- [Bugfix] Update multimodel models mapping to fit new checkpoint after Transformers v4.52 (#19151) · ca94d7fa
  Isotr0py authored Jun 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ca94d7fa
- Fixes IMA for TP w/ flex-attention (#19712) · ddfed314
  Driss Guessous authored Jun 16, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  ddfed314