Commits · b6e7e3d58f57aee30a55b3160645ddb2f029d3c8 · OpenDAS / vllm_cscc · GitLab

09 Jul, 2025 9 commits
- [Intel GPU] support ray as distributed executor backend for XPU. (#20659) · b6e7e3d5
  Kunshang Ji authored Jul 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b6e7e3d5
- [XPU] Use spawn with XPU multiprocessing (#20649) · e760fcef
  Dmitry Rogozhkin authored Jul 09, 2025
```
Signed-off-by: Dmitry Rogozhkin <dmitry.v.rogozhkin@intel.com>
```
  e760fcef
- [Misc] Fix the size of batched_dummy_mm_inputs in profile_run (#20434) · 6bbf1795
  B-201 authored Jul 09, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  6bbf1795
- [feat] enable SM100 CUTLASS block scaled group gemm for smaller batch sizes (#20640) · 97abeb1d
  Duncan Moss authored Jul 08, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  97abeb1d
- [Bugfix] set default set cuda_graph_sizes to min(self.max_num_seqs * 2, 512) (#20628) · 34dad19e
  zhrrr authored Jul 09, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  34dad19e
- [Hardware][PPC64LE] Enable V1 for ppc64le and ARM (#20554) · 6db31e7a
  Akash kaothalkar authored Jul 09, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
  6db31e7a
- [BugFix][Intel GPU] Use refactored API for dist_backend in V1 worker (#20596) · c40784c7
  Ratnam Parikh authored Jul 08, 2025
```
Signed-off-by: ratnampa <ratnam.parikh@intel.com>
```
  c40784c7
- [tech debt] Revisit lora request model checker (#20636) · baed180a
  kourosh hakhamaneshi authored Jul 08, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  baed180a
- [misc]refactor `Platform.set_device` method (#20262) · 0b407479
  Kunshang Ji authored Jul 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  0b407479
08 Jul, 2025 15 commits
- [Bugfix] Fix GLM-4.1-V video prompt update (#20635) · b9fca832
  Isotr0py authored Jul 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b9fca832
- [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630) · 32dffc27
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32dffc27
- [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166) · c438183e
  Ming Yang authored Jul 08, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  c438183e
- Revert invalid spellchecker fix on deepseek_vl2 (#20618) · c6c22f16
  viravera authored Jul 08, 2025
  
  c6c22f16
- [Model] Implement missing `get_language_model` for Keye-VL (#20631) · dd382e0f
  Cyrus Leung authored Jul 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dd382e0f
- [xpu]feat: support multi-lora on xpu (#20616) · a4c23314
  Yan Ma authored Jul 08, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
```
  a4c23314
- [PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139) · 71d1d75b
  Nicolò Lucchesi authored Jul 08, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  71d1d75b
- [Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e
  Sanger Steel authored Jul 08, 2025
```
[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>
```
  72d14d0e
- [TPU] Temporary fix vmem oom for long model len by reducing page size (#20278) · e34d130c
  Chenyaaang authored Jul 07, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  e34d130c
- [CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560) · 7721ef17
  Li, Jiang authored Jul 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7721ef17
- [Misc] improve error msg (#20604) · 8369b7c2
  Reid authored Jul 08, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  8369b7c2
- [Bugfix]: Fix messy code when using logprobs (#19209) · 93b9d9f4
  Chauncey authored Jul 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  93b9d9f4
- [Optimize] Don't send token ids when kv connector is not used (#20586) · 31c5d0a1
  Woosuk Kwon authored Jul 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  31c5d0a1
- [Bugfix] Fix Maverick correctness by filling zero to cache space in cutlass_moe (#20167) · afb7cff1
  Ming Yang authored Jul 07, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  afb7cff1
- [Misc] Improve logging for dynamic shape cache compilation (#20573) · d2e841a1
  Kyle Yu authored Jul 07, 2025
```
Signed-off-by: kyolebu <kyu@redhat.com>
```
  d2e841a1
07 Jul, 2025 14 commits
- [Config] Refactor mistral configs (#20570) · 14601f5f
  Patrick von Platen authored Jul 08, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  14601f5f
- Fix links in multi-modal model contributing page (#18615) · 042d131f
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  042d131f
- [Misc] feat output content in stream response (#19608) · 8e807cdf
  rongfu.leng authored Jul 08, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  8e807cdf
- [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) · e601efcb
  Anton authored Jul 07, 2025
```
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
```
  e601efcb
- [Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel (#20308) · 22dd9c27
  jvlunteren authored Jul 07, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  22dd9c27
- [DP] Copy environment variables to Ray DPEngineCoreActors (#20344) · a6d795d5
  Rui Qiao authored Jul 07, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  a6d795d5
- [Front-end] microbatch tokenization (#19334) · a37d75bb
  ztang2370 authored Jul 08, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  a37d75bb
- [Bugfix] Prevent IndexError for cached requests when pipeline parallelism is disabled (#20486) · edd270bc
  Peter Pan authored Jul 08, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  edd270bc
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
- [Misc] remove unused jinaai_serving_reranking (#18878) · 448acad3
  Abirdcfly authored Jul 07, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  448acad3
- [XPU] log clean up for XPU platform (#20553) · 3112271f
  Yan Ma authored Jul 07, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
```
  3112271f
- [XPU][CI] add v1/core test in xpu hardware ci (#20537) · 2c5ebec0
  Liangliang Ma authored Jul 07, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  2c5ebec0
- [Refactor]Abstract Platform Interface for Distributed Backend and Add xccl... · 6e2c19ce
  Yang Yang authored Jul 07, 2025
```
[Refactor]Abstract Platform Interface for Distributed Backend and Add xccl Support for Intel XPU (#19410)
Signed-off-by: dbyoung18 <yang5.yang@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6e2c19ce
- Implement OpenAI Responses API [1/N] (#20504) · 462b2692
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  462b2692
06 Jul, 2025 2 commits
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [BugFix][Spec Decode] Fix spec token ids in model runner (#20530) · 9528e3a0
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9528e3a0