Commits · f3a683b7c9df8b251092e48e53d58220bb920f2c · OpenDAS / vllm_cscc · GitLab

25 Jul, 2025 24 commits
- [Bugfix][Logprobs] Fix logprobs op to support more backend (#21591) · f3a683b7
  Mengqing Cao authored Jul 25, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  f3a683b7
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69
- [Quantization] Enable BNB support for more MoE models (#21370) · 5c3f2628
  Jee Jee Li authored Jul 25, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  5c3f2628
- [Bugfix] GGUF: fix AttributeError: 'PosixPath' object has no attribute 'startswith' (#21579) · 7311f744
  Kebe authored Jul 25, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  7311f744
- Add H20-3e fused MoE kernel tuning configs for Qwen3-Coder-480B-A35B-Instruct (#21598) · 8ed01e32
  Xu Wenqing authored Jul 25, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  8ed01e32
- [Tests] Harden DP tests (#21508) · e38e96a3
  Nick Hill authored Jul 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  e38e96a3
- [TPU][Bugfix] fix OOM issue in CI test (#21550) · 40d86ee4
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  40d86ee4
- [Misc] Removed undefined cmake variables MOE_PERMUTE_ARCHS (#21262) · 85d051f0
  Yang Chen authored Jul 24, 2025
```
Signed-off-by: Yang Chen <yangche@fb.com>
```
  85d051f0
- [CI/Build] fix cpu_extension for apple silicon (#21195) · 5140f54b
  Ignacio Sica authored Jul 25, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
```
  5140f54b
- [Misc][Tools] make max-model-len a parameter in auto_tune script (#21321) · 947edd09
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  947edd09
- [Model] Fix a check for None but the return value was empty list in Gemma3 MM... · fde60ee7
  hfan authored Jul 25, 2025
```
[Model] Fix a check for None but the return value was empty list in Gemma3 MM vision_embeddings (#21479)
Signed-off-by: Hongmin Fan <fanhongmin@google.com>
```
  fde60ee7
- [Model] Support tensor parallel for timm ViT in Deepseek_vl2 (#21494) · b38bc652
  Jason Gu authored Jul 25, 2025
```
Signed-off-by: wzqd <1057337859@qq.com>
```
  b38bc652
- [Bugfix] fix modelscope snapshot_download serialization (#21536) · adaf2c6d
  Ning Xie authored Jul 25, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  adaf2c6d
- [CI] Update CODEOWNERS for CPU and Intel GPU (#21582) · 42343f1f
  Li, Jiang authored Jul 25, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  42343f1f
- Integrate TensorSchema with shape validation for Phi3VImagePixelInputs (#21232) · 965bc71b
  Benji Beck authored Jul 24, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  965bc71b
- [Docs] Add `requirements/common.txt` to run unit tests (#21572) · 807a328b
  Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
  807a328b
- [TPU][Test] Temporarily suspend this MoE model in test_basic.py. (#21560) · e0be2c4d
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  e0be2c4d
- [DP] Support api-server-count > 0 in hybrid DP LB mode (#21510) · 9c8b2c2a
  Nick Hill authored Jul 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9c8b2c2a
- [Bugfix] DeepGemm utils : Fix hardcoded type-cast (#21517) · 2212cd6c
  Varun Sundar Rabindranath authored Jul 25, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  2212cd6c
- [Kernel] adding fused_moe configs for upcoming granite4 (#21332) · ce3a9b13
  Burkhard Ringlein authored Jul 25, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  ce3a9b13
- Fix GLM-4 PP Missing Layer When using with PP. (#21531) · 2ce90e5b
  Yuxuan Zhang authored Jul 25, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  2ce90e5b
- [Bug] Fix DeepGemm Init Error (#21554) · 633f6e80
  Wentao Ye authored Jul 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  633f6e80
- [Docs] Fix `site_url` for RunLLM (#21564) · b57296bb
  Harry Mellor authored Jul 25, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b57296bb
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
24 Jul, 2025 16 commits
- [MoE] More balanced expert sharding (#21497) · fe56180c
  Woosuk Kwon authored Jul 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  fe56180c
- [TPU][TEST] HF_HUB_DISABLE_XET=1 the test 3. (#21539) · 07d80d7b
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  07d80d7b
- update flashinfer to v0.2.9rc1 (#21485) · 2dd72d23
  weiliang authored Jul 25, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
  2dd72d23
- [Docs] Add Expert Parallelism Initial Documentation (#21373) · a6c7fb8c
  Simon Mo authored Jul 24, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6c7fb8c
- [Docs][minor] Fix broken gh-file link in distributed serving docs (#21543) · a7272c23
  Ricardo Decal authored Jul 24, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  a7272c23
- [P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849
  Juncheng Gu authored Jul 24, 2025
```
Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>
```
  60662849
- [P/D] Move FakeNixlWrapper to test dir (#21328) · 1e9ea8e6
  Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  1e9ea8e6
- [XPU] Conditionally import CUDA-specific passes to avoid import errors on xpu platform (#21036) · d9f9a3fd
  Chaojun Zhang authored Jul 24, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  d9f9a3fd
- Update flashinfer CUTLASS MoE Kernel (#21408) · 1b25f1fe
  Shu Wang authored Jul 24, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  1b25f1fe
- [Bug] Fix Compressed Tensor NVFP4 `cutlass_fp4_group_mm` illegal memory access (#21465) · e8cb0d04
  Wentao Ye authored Jul 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e8cb0d04
- [Docs] Rewrite Distributed Inference and Serving guide (#20593) · 68417411
  Ricardo Decal authored Jul 24, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  68417411
- [Docs] Update Tensorizer usage documentation (#21190) · cdb79ee6
  Sanger Steel authored Jul 24, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Signed-off-by: William Goldby <willgoldby@gmail.com>
Co-authored-by: William Goldby <willgoldby@gmail.com>
```
  cdb79ee6
- [Fix] Update mamba_ssm to 2.2.5 (#21421) · 5a19a6c6
  elvischenv authored Jul 24, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  5a19a6c6
- [Bugfix] Fix CUDA arch flags for MoE permute (#21426) · 2ded067f
  Ming Yang authored Jul 24, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  2ded067f
- [Model] Officially support Emu3 with Transformers backend (#21319) · 13abd0ea
  Harry Mellor authored Jul 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  13abd0ea
- [Attention] Optimize FlashInfer MetadataBuilder Build call (#21137) · 61b8cea3
  Lucas Wilkinson authored Jul 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  61b8cea3