Commits · d8ee5a2ca4c73f2ce5fdc386ce5b4ef3b6e6ae70 · OpenDAS / vllm_cscc · GitLab

08 Jul, 2025 27 commits
- [TPU][Bugfix] disable phi-3 test (#20632) · d8ee5a2c
  QiliangCui authored Jul 08, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  d8ee5a2c
- [Bugfix] Fix GLM-4.1-V video prompt update (#20635) · b9fca832
  Isotr0py authored Jul 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b9fca832
- [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630) · 32dffc27
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32dffc27
- [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166) · c438183e
  Ming Yang authored Jul 08, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  c438183e
- [CI] Increase the threshold of the MTEB RERANK tests (#20615) · baba0389
  wang.yuqi authored Jul 08, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  baba0389
- Revert invalid spellchecker fix on deepseek_vl2 (#20618) · c6c22f16
  viravera authored Jul 08, 2025
  
  c6c22f16
- [Model] Implement missing `get_language_model` for Keye-VL (#20631) · dd382e0f
  Cyrus Leung authored Jul 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dd382e0f
- Update torch/xla pin to 20250703 (#20589) · 849590a2
  XiongfeiWei authored Jul 08, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  849590a2
- [xpu]feat: support multi-lora on xpu (#20616) · a4c23314
  Yan Ma authored Jul 08, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
```
  a4c23314
- Stop using title frontmatter and fix doc that can only be reached by search (#20623) · b942c094
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b942c094
- Remove unnecessary explicit title anchors and use relative links instead (#20620) · b4bab816
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b4bab816
- [Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601) · b91cb3fa
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  b91cb3fa
- [PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139) · 71d1d75b
  Nicolò Lucchesi authored Jul 08, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  71d1d75b
- [Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e
  Sanger Steel authored Jul 08, 2025
```
[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>
```
  72d14d0e
- [TPU] Temporary fix vmem oom for long model len by reducing page size (#20278) · e34d130c
  Chenyaaang authored Jul 07, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  e34d130c
- [CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560) · 7721ef17
  Li, Jiang authored Jul 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7721ef17
- [Misc] improve error msg (#20604) · 8369b7c2
  Reid authored Jul 08, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  8369b7c2
- [Docs] Add Anyscale to frameworks (#20590) · 3eb4ad53
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  3eb4ad53
- [Docs] Add Ray Serve LLM section to openai compatible server guide (#20595) · 90a2769f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  90a2769f
- [Docs] Improve docstring for ray data llm example (#20597) · e60d422f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  e60d422f
- [Docs] Rewrite offline inference guide (#20594) · 0d914c81
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  0d914c81
- [Doc] Syntax highlight request responses as JSON instead of bash (#20582) · 6e428cdd
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6e428cdd
- [Bugfix]: Fix messy code when using logprobs (#19209) · 93b9d9f4
  Chauncey authored Jul 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  93b9d9f4
- Make distinct `code` and `console` admonitions so readers are less likely to miss them (#20585) · af107d5a
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af107d5a
- [Optimize] Don't send token ids when kv connector is not used (#20586) · 31c5d0a1
  Woosuk Kwon authored Jul 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  31c5d0a1
- [Bugfix] Fix Maverick correctness by filling zero to cache space in cutlass_moe (#20167) · afb7cff1
  Ming Yang authored Jul 07, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  afb7cff1
- [Misc] Improve logging for dynamic shape cache compilation (#20573) · d2e841a1
  Kyle Yu authored Jul 07, 2025
```
Signed-off-by: kyolebu <kyu@redhat.com>
```
  d2e841a1
07 Jul, 2025 13 commits
- [Config] Refactor mistral configs (#20570) · 14601f5f
  Patrick von Platen authored Jul 08, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  14601f5f
- Fix links in multi-modal model contributing page (#18615) · 042d131f
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  042d131f
- [Misc] feat output content in stream response (#19608) · 8e807cdf
  rongfu.leng authored Jul 08, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  8e807cdf
- [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) · e601efcb
  Anton authored Jul 07, 2025
```
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
```
  e601efcb
- [Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel (#20308) · 22dd9c27
  jvlunteren authored Jul 07, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  22dd9c27
- [DP] Copy environment variables to Ray DPEngineCoreActors (#20344) · a6d795d5
  Rui Qiao authored Jul 07, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  a6d795d5
- [Front-end] microbatch tokenization (#19334) · a37d75bb
  ztang2370 authored Jul 08, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  a37d75bb
- [Bugfix] Prevent IndexError for cached requests when pipeline parallelism is disabled (#20486) · edd270bc
  Peter Pan authored Jul 08, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  edd270bc
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
- [Doc] Fix some MkDocs snippets used in the installation docs (#20572) · 1ad69e83
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1ad69e83
- [Doc] Add outline for content tabs (#20571) · b8a498c9
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b8a498c9
- [Doc] Fix internal links so they don't always point to latest (#20563) · 923147b5
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  923147b5
- [Doc] Use `gh-pr` and `gh-issue` everywhere we can in the docs (#20564) · 45877ef7
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  45877ef7