Commits · 22dd9c2730dc1124b9d0ac15fff223d0b8d9020b · OpenDAS / vllm_cscc · GitLab

07 Jul, 2025 20 commits
- [Kernel] Optimize Prefill Attention in Unified Triton Attention Kernel (#20308) · 22dd9c27
  jvlunteren authored Jul 07, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  22dd9c27
- [DP] Copy environment variables to Ray DPEngineCoreActors (#20344) · a6d795d5
  Rui Qiao authored Jul 07, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  a6d795d5
- [Front-end] microbatch tokenization (#19334) · a37d75bb
  ztang2370 authored Jul 08, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  a37d75bb
- [Bugfix] Prevent IndexError for cached requests when pipeline parallelism is disabled (#20486) · edd270bc
  Peter Pan authored Jul 08, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  edd270bc
- [Model][Last/4] Automatic conversion of CrossEncoding model (#19675) · 110df743
  wang.yuqi authored Jul 07, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  110df743
- [Doc] Fix some MkDocs snippets used in the installation docs (#20572) · 1ad69e83
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1ad69e83
- [Doc] Add outline for content tabs (#20571) · b8a498c9
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b8a498c9
- [Doc] Fix internal links so they don't always point to latest (#20563) · 923147b5
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  923147b5
- [Doc] Use `gh-pr` and `gh-issue` everywhere we can in the docs (#20564) · 45877ef7
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  45877ef7
- [Doc] Remove extra whitespace from CI failures doc (#20565) · 6e4bef1b
  Harry Mellor authored Jul 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6e4bef1b
- [Misc] Set the minimum openai version (#20539) · 4ff79a13
  Jee Jee Li authored Jul 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  4ff79a13
- [Misc] remove unused jinaai_serving_reranking (#18878) · 448acad3
  Abirdcfly authored Jul 07, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  448acad3
- [Docs] Clean up tables in supported_models.md (#20552) · eb0b2d2f
  Michael Yao authored Jul 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  eb0b2d2f
- [XPU] log clean up for XPU platform (#20553) · 3112271f
  Yan Ma authored Jul 07, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
```
  3112271f
- Add docstrings to url_schemes.py to improve readability (#20545) · 1fd471e9
  Michael Yao authored Jul 07, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  1fd471e9
- [XPU][CI] add v1/core test in xpu hardware ci (#20537) · 2c5ebec0
  Liangliang Ma authored Jul 07, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  2c5ebec0
- [CI/Build] Enable phi2 lora test (#20540) · 2e610deb
  Jee Jee Li authored Jul 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2e610deb
- [Refactor]Abstract Platform Interface for Distributed Backend and Add xccl... · 6e2c19ce
  Yang Yang authored Jul 07, 2025
```
[Refactor]Abstract Platform Interface for Distributed Backend and Add xccl Support for Intel XPU (#19410)
Signed-off-by: dbyoung18 <yang5.yang@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6e2c19ce
- [Misc] add a tip for pre-commit (#20536) · 47db8c2c
  Reid authored Jul 07, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  47db8c2c
- Implement OpenAI Responses API [1/N] (#20504) · 462b2692
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  462b2692
06 Jul, 2025 13 commits
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [BugFix][Spec Decode] Fix spec token ids in model runner (#20530) · 9528e3a0
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9528e3a0
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
- [V0 deprecation] Remove V0 CPU/XPU/TPU backends (#20412) · e202dd27
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  e202dd27
- [Misc] call the pre-defined func (#20518) · 43813e63
  Reid authored Jul 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  43813e63
- [Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b
  Brayden Zhong authored Jul 06, 2025
```
[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  cede942b
- [Frontend] Support image object in llm.chat (#19635) · fe1e9248
  Flora Feng authored Jul 05, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
```
  fe1e9248
- [TPU][Bugfix] fix the MoE OOM issue (#20339) · 4548c03c
  Chengji Yao authored Jul 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  4548c03c
- [BugFix] Fix: ImportError when building on hopper systems (#20513) · 40b86aa0
  Lucas Wilkinson authored Jul 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  40b86aa0
- [Bugfix] Fix missing per_act_token parameter in compressed_tensors_moe (#20509) · 43287082
  Lucia Fang authored Jul 06, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  43287082
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
- test_attention compat with coming xformers change (#20487) · c5ebe040
  Jeremy Reizenstein authored Jul 06, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c5ebe040
- [Misc] remove unused import (#20517) · 8d763cb8
  Reid authored Jul 06, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  8d763cb8
05 Jul, 2025 6 commits
- [Misc] Add logger.exception for TPU information collection failures (#20510) · cf4cd539
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  cf4cd539
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
- Fix unknown attribute of topk_indices_dtype in CompressedTensorsW8A8Fp8MoECutlassMethod (#20507) · 8aeaa910
  Lucia Fang authored Jul 05, 2025
```
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  8aeaa910
- [Misc] Remove the unused LoRA test code (#20494) · 906e05d8
  Jee Jee Li authored Jul 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  906e05d8
- [doc] small fix (#20506) · ef9a2990
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  ef9a2990
- [Misc] Add security warning for development mode endpoints (#20508) · 7e908704
  Reid authored Jul 05, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  7e908704
04 Jul, 2025 1 commit
- [Doc] fix mutltimodal_inputs.md gh examples link (#20497) · d3f05c92
  Guy Stone authored Jul 05, 2025
```
Signed-off-by: Guy Stone <guys@spotify.com>
```
  d3f05c92