Commits · 16f32505275687c01823b87134ce2d93f89407ad · OpenDAS / vllm_cscc · GitLab

30 Jul, 2025 16 commits
- [CI/Build] Fix pre-commit failure in docs (#21897) · 16f32505
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  16f32505
- Add @sighingnow as maintainer of qwen's related files. (#21895) · e3bc17ce
  Tao He authored Jul 30, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  e3bc17ce
- [XPU] use `ZE_AFFINITY_MASK` for device select on xpu (#21815) · 05cbbe20
  Kunshang Ji authored Jul 30, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  05cbbe20
- [Frontend] Add LLM.reward specific to reward models (#21720) · 65f311ce
  wang.yuqi authored Jul 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  65f311ce
- [Perf] Using `__nv_fp8_e4m3` instead of `c10::e4m3` for `per_token_group_quant` (#21867) · 1b0a1555
  Wentao Ye authored Jul 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1b0a1555
- [Bugfix] Actually disable processing cache when API server is scaled out (#21839) · 44bc46da
  Cyrus Leung authored Jul 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44bc46da
- [Bugfix] Fix comment typo of get_num_common_prefix_blocks() (#21827) · b7b23da4
  MingzhenHan authored Jul 30, 2025
```
Signed-off-by: MingzhenHan <hanmingzhen2002@outlook.com>
```
  b7b23da4
- [Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with... · fdde1822
  Areeb Syed authored Jul 30, 2025
```
[Bugfix] Fix shape mismatch assertion error when loading Gemma3n model with BitsAndBytes quantization (#21808)
Signed-off-by: sydarb <areebsyed237@gmail.com>
```
  fdde1822
- Expose PyTorch profiler configuration to environment variables (#21803) · b917da44
  Csrayz authored Jul 30, 2025
```
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com>
```
  b917da44
- [Docs] Update docker.md with HF_TOKEN, new model, and podman fix (#21856) · fb58e3a6
  Michael Goin authored Jul 29, 2025
  
  fb58e3a6
- [DOC] Fix path of v1 related figures (#21868) · 76080cff
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  76080cff
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
- [v1][attention] Support Hybrid Allocator + FlashInfer (#21412) · 555e7225
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  555e7225
- [Bugfix] Correct max tokens for non-contiguous embeds (#21798) · 0e36abf9
  milesial authored Jul 29, 2025
```
Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
```
  0e36abf9
- [ci] mark blackwell test optional for now (#21878) · 452b2a31
  Simon Mo authored Jul 29, 2025
  
  452b2a31
- [ci] add b200 test placeholder (#21866) · 0d0cc9e1
  Simon Mo authored Jul 29, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  0d0cc9e1
29 Jul, 2025 24 commits
- [BugFix] Fix interleaved sliding window not set for Gemma3n (#21863) · 9266d980
  Yong Hoon Shin authored Jul 29, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  9266d980
- Revert "[AMD][CI/Build] Fix the AMD issue caused by inappropriate of symbol... · 176bbce1
  Gregory Shtrasberg authored Jul 29, 2025
```
Revert "[AMD][CI/Build] Fix the AMD issue caused by inappropriate of symbol exposure (#21647)" (#21850)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  176bbce1
- docker: docker-aware precompiled wheel support (#21127) · a1873db2
  Doug Smith authored Jul 29, 2025
```
Signed-off-by: dougbtv <dosmith@redhat.com>
```
  a1873db2
- Add `flashinfer_python` to CUDA wheel requirements (#21389) · a33ea28b
  Michael Goin authored Jul 29, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a33ea28b
- [Doc] update Contributing page's testing section (#18272) · 7b49cb1c
  David Xia authored Jul 29, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  7b49cb1c
- [Doc] Add FusedMoE Modular Kernel Documentation (#21623) · f03e9cf2
  Varun Sundar Rabindranath authored Jul 29, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  f03e9cf2
- [Docs] use `uv` in GPU installation docs (#20277) · 37f86d90
  David Xia authored Jul 29, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  37f86d90
- [Bugfix] Fix workspace buffer None issue for Flashinfer TRTLLM Backend (#21525) · 58b11b24
  elvischenv authored Jul 29, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  58b11b24
- [Bugfix]fix mixed bits and visual language model quantization in AutoRound (#21802) · ad341c51
  Wenhua Cheng authored Jul 29, 2025
```
Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
```
  ad341c51
- [TPU] Add an optimization doc on TPU (#21155) · 759b87ef
  Brittany authored Jul 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  759b87ef
- [Docs] Merge design docs for a V1 only future (#21832) · f693b067
  Harry Mellor authored Jul 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f693b067
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
- [Doc] Update compatibility matrix for pooling and multimodal models (#21831) · ab714131
  Cyrus Leung authored Jul 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ab714131
- [KVCache] Make KVCacheSpec hashable (#21791) · 755fa8b6
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  755fa8b6
- [Docs] Fix the outdated URL for installing from vLLM binaries (#21523) · 24704191
  Kay Yan authored Jul 29, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  24704191
- [Model] Refactor JambaForCausalLM (#21394) · 61a6905a
  Jee Jee Li authored Jul 29, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  61a6905a
- [V0 deprecation] Guided decoding (#21347) · 37efc63b
  Reza Barazesh authored Jul 29, 2025
```
Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  37efc63b
- [Model]: Fused MoE for nomic-embed-text-v2-moe (#18321) · a4528f0c
  Isotr0py authored Jul 29, 2025
```
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a4528f0c
- [Doc] Link to RFC for pooling optimizations (#21806) · a2480251
  Cyrus Leung authored Jul 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a2480251
- [Misc] Rework process titles (#21780) · 7234fe26
  Nick Hill authored Jul 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7234fe26
- Migrate InternVLImageInputs and InternVLVideoInputs to TensorSchema (#21684) · f1e2c095
  Benji Beck authored Jul 28, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  f1e2c095
- [AMD][CI/Build][Bugfix] Guarding CUDA specific functions by ifndef ROCM (#21766) · 12a223ef
  Gregory Shtrasberg authored Jul 28, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  12a223ef
- skip fusedmoe layer for start_load_kv (#21378) · e18f0851
  Calvin Chen authored Jul 29, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  e18f0851
- [CI] Parallelize Kernels MoE Test (#21764) · afa26075
  Michael Goin authored Jul 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  afa26075