Commits · 90a2769f2030bd11299f83871d7bc1c06db88cfb · OpenDAS / vllm_cscc · GitLab

08 Jul, 2025 9 commits
- [Docs] Add Ray Serve LLM section to openai compatible server guide (#20595) · 90a2769f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  90a2769f
- [Docs] Improve docstring for ray data llm example (#20597) · e60d422f
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  e60d422f
- [Docs] Rewrite offline inference guide (#20594) · 0d914c81
  Ricardo Decal authored Jul 07, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  0d914c81
- [Doc] Syntax highlight request responses as JSON instead of bash (#20582) · 6e428cdd
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6e428cdd
- [Bugfix]: Fix messy code when using logprobs (#19209) · 93b9d9f4
  Chauncey authored Jul 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  93b9d9f4
- Make distinct `code` and `console` admonitions so readers are less likely to miss them (#20585) · af107d5a
  Harry Mellor authored Jul 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af107d5a
- [Optimize] Don't send token ids when kv connector is not used (#20586) · 31c5d0a1
  Woosuk Kwon authored Jul 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  31c5d0a1
- [Bugfix] Fix Maverick correctness by filling zero to cache space in cutlass_moe (#20167) · afb7cff1
  Ming Yang authored Jul 07, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  afb7cff1
- [Misc] Improve logging for dynamic shape cache compilation (#20573) · d2e841a1
  Kyle Yu authored Jul 07, 2025
```
Signed-off-by: kyolebu <kyu@redhat.com>
```
  d2e841a1
07 Jul, 2025 24 commits
- [Config] Refactor mistral configs (#20570) · 14601f5f
  Patrick von Platen authored Jul 08, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  14601f5f
- Fix links in multi-modal model contributing page (#18615) · 042d131f
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  042d131f
- [Misc] feat output content in stream response (#19608) · 8e807cdf
  rongfu.leng authored Jul 08, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  8e807cdf
- [Misc] Add fully interleaved support for multimodal 'string' content format (#14047) · e601efcb
  Anton authored Jul 07, 2025
```
Signed-off-by: drobyshev.anton <drobyshev.anton@wb.ru>
Co-authored-by: drobyshev.anton <drobyshev.anton@wb.ru>
```
  e601efcb
- [Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel (#20308) · 22dd9c27
  jvlunteren authored Jul 07, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  22dd9c27
- [DP] Copy environment variables to Ray DPEngineCoreActors (#20344) · a6d795d5
  Rui Qiao authored Jul 07, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  a6d795d5
- [Front-end] microbatch tokenization (#19334) · a37d75bb
  ztang2370 authored Jul 08, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  a37d75bb
- [Bugfix] Prevent IndexError for cached requests when pipeline parallelism is disabled (#20486) · edd270bc
  Peter Pan authored Jul 08, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  edd270bc
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
- [Doc] Fix some MkDocs snippets used in the installation docs (#20572) · 1ad69e83
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1ad69e83
- [Doc] Add outline for content tabs (#20571) · b8a498c9
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b8a498c9
- [Doc] Fix internal links so they don't always point to latest (#20563) · 923147b5
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  923147b5
- [Doc] Use `gh-pr` and `gh-issue` everywhere we can in the docs (#20564) · 45877ef7
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  45877ef7
- [Doc] Remove extra whitespace from CI failures doc (#20565) · 6e4bef1b
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6e4bef1b
- [Misc] Set the minimum openai version (#20539) · 4ff79a13
  Jee Jee Li authored Jul 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4ff79a13
- [Misc] remove unused jinaai_serving_reranking (#18878) · 448acad3
  Abirdcfly authored Jul 07, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  448acad3
- [Docs] Clean up tables in supported_models.md (#20552) · eb0b2d2f
  Michael Yao authored Jul 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  eb0b2d2f
- [XPU] log clean up for XPU platform (#20553) · 3112271f
  Yan Ma authored Jul 07, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
```
  3112271f
- Add docstrings to url_schemes.py to improve readability (#20545) · 1fd471e9
  Michael Yao authored Jul 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  1fd471e9
- [XPU][CI] add v1/core test in xpu hardware ci (#20537) · 2c5ebec0
  Liangliang Ma authored Jul 07, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  2c5ebec0
- [CI/Build] Enable phi2 lora test (#20540) · 2e610deb
  Jee Jee Li authored Jul 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2e610deb
- [Refactor]Abstract Platform Interface for Distributed Backend and Add xccl... · 6e2c19ce
  Yang Yang authored Jul 07, 2025
```
[Refactor]Abstract Platform Interface for Distributed Backend and Add xccl Support for Intel XPU (#19410)
Signed-off-by: dbyoung18 <yang5.yang@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6e2c19ce
- [Misc] add a tip for pre-commit (#20536) · 47db8c2c
  Reid authored Jul 07, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  47db8c2c
- Implement OpenAI Responses API [1/N] (#20504) · 462b2692
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  462b2692
06 Jul, 2025 7 commits
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [BugFix][Spec Decode] Fix spec token ids in model runner (#20530) · 9528e3a0
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9528e3a0
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
- [V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e202dd27
- [Misc] call the pre-defined func (#20518) · 43813e63
  Reid authored Jul 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  43813e63
- [Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b
  Brayden Zhong authored Jul 06, 2025
```
[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  cede942b
- [Frontend] Support image object in llm.chat (#19635) · fe1e9248
  Flora Feng authored Jul 05, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
```
  fe1e9248