Commits · 4ff61ababa25f4a519185013c9cce00142341f04 · OpenDAS / vllm_cscc

"csrc/vscode:/vscode.git/clone" did not exist on "82e40fb78fe722112f2924bea782f9f266f42339"

03 Jul, 2025 8 commits
- [TPU] Add a case to cover RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 (#20385) · 4ff61aba
  QiliangCui authored Jul 02, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  4ff61aba
- [Bugfix][CI/CD][CPU] Fix CPU CI tests (#20383) · 0ec3779d
  Li, Jiang authored Jul 03, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0ec3779d
- [Misc] Small: Fix video loader return type annotations. (#20389) · b616f6a5
  Chenheli Hua authored Jul 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  b616f6a5
- [Bugfix] Fix import of CutlassExpertsFp8 in compressed_tensors_moe.py (#20381) · 2e25bb12
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  2e25bb12
- Enable CPU nightly performance benchmark and its Markdown report (#18444) · 9965c47d
  Louie Tsai authored Jul 02, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
  9965c47d
- [BugFix] Fix DP headless mode arg validation (#20398) · 059d4cdb
  Nick Hill authored Jul 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  059d4cdb
- [Bugfix] Fixes for FlashInfer's TORCH_CUDA_ARCH_LIST (#20136) · bdb84e26
  Tyler Michael Smith authored Jul 02, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
```
  bdb84e26
- [Docs] Update EAGLE example (#20375) · 3dd35914
  Nicolò Lucchesi authored Jul 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3dd35914
02 Jul, 2025 30 commits
- [DP] Support external DP Load Balancer mode (#19790) · 657f2f30
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  657f2f30
- [ROCm][FEAT] Enable Full Graph Mode in AITER MLA V1 Attn Backend (Decode Phase only) (#20254) · a1aafc82
  vllmellm authored Jul 03, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  a1aafc82
- [Misc] add handler HF_TOKEN is emptry string (#20369) · 139508a4
  rongfu.leng authored Jul 03, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  139508a4
- [Minor] Clean up incorrect comment in test (#20382) · d265414d
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d265414d
- [V1] LogitsProcessor programming model (#16728) · 48fb076c
  afeldman-nm authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  48fb076c
- [Kernels] MoE refactor (#19636) · c1909e7e
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
```
  c1909e7e
- Documentation update tool_calling: mapping back to function from response (#20373) · b9587750
  cronoik-inceptionai authored Jul 02, 2025
  
  b9587750
- [Model] Adds support for SlimMoE models Phi-tiny-MoE-instruct (#20286) · 706ff132
  zichongli5 authored Jul 02, 2025
```
Signed-off-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Zichong Li <t-lizichong@microsoft.com@Reasoning-H100-VM3.drbuo4tcjzruhloch3eo0b25ef.cx.internal.cloudapp.net>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  706ff132
- [Bugfix] Fix the max_seq_len limit of 16384 for DeepSeek models (#20322) · ccbfb1d1
  WangHuaqiang authored Jul 02, 2025
```
Signed-off-by: Wang Huaqiang <huaqiang.wang@intel.com>
```
  ccbfb1d1
- [NVIDIA] Support Cutlass w8a8 FP8 for Blackwell Geforce GPUs (sm120) (#17280) · 9e5552aa
  Joonchen Liau authored Jul 02, 2025
```
Signed-off-by: kaln27 <liaojuncheng123@foxmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  9e5552aa
- [Build/CI] Automatically tag DeepSeek related PRs (#20370) · 0c600b9a
  Lu Fang authored Jul 02, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  0c600b9a
- [Model] Add Ernie4.5 and Ernie4.5MoE Model Support (#20220) · e303dcf5
  CSWYF3634076 authored Jul 02, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  e303dcf5
- [Docs] Make TPU ref prettier in google_tpu.md (#20356) · ae9c4d41
  Michael Yao authored Jul 02, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  ae9c4d41
- [Docs] Fix indentations for 2-level items in deprecation_policy.md (#20352) · d853520b
  Michael Yao authored Jul 02, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  d853520b
- [Bugfix] Keye-VL compatibility with `tok_kwargs` (#20058) (#20353) · ba51aea6
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba51aea6
- [Model][VLM] Support Keye-VL-8B-Preview (#20126) · 8452946c
  Kwai-Keye authored Jul 02, 2025
```
Signed-off-by: Kwai-Keye <Keye@kuaishou.com>
```
  8452946c
- [Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d
  Chenheli Hua authored Jul 01, 2025
```
[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  2e7cbf2d
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
- [Doc][TPU] Add models and features supporting matrix. (#20230) · b205e846
  QiliangCui authored Jul 01, 2025
```
Signed-off-by: Qiliang Cui <cuiq@google.com>
```
  b205e846
- fix[Docs]: link anchor is incorrect #20309 (#20315) · be0cfb2b
  yyzxw authored Jul 02, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
  be0cfb2b
- [Bugfix] Fix dynamic rotary embedding (#20343) · 1a03dd49
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1a03dd49
- [FIX][Intel GPU]fix ipex flash_attn_varlen_func api missing parameter (#20348) · 27b80176
  Kunshang Ji authored Jul 02, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  27b80176
- [Misc][Doc] Add missing comment for LLM (#20285) · 9ec1e306
  Lifans authored Jul 01, 2025
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  9ec1e306
- [Refactor] Remove Unused Env `VLLM_ENABLE_MOE_ALIGN_BLOCK_SIZE_TRITON` (#20334) · 9dae7d46
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9dae7d46
- [Refactor] Remove duplicate `find_free_port` (#20333) · 7058d7dd
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7058d7dd
- [UT][intel GPU] use current_platform instead of device hardcode in v1 tests (#20169) · a0389e05
  Liangliang Ma authored Jul 02, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  a0389e05
- [Kernel][Bugfix] Fixup some warnings in nvfp4_blockwise_moe when CUDA < 12.8 (#20324) · 3be8d312
  Tyler Michael Smith authored Jul 01, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3be8d312
- Enable group size 64 for Machete (#20290) · 3abfe221
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  3abfe221
- [Refactor] Refactor import utils (#20269) · e81fbefe
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e81fbefe
- remove unused variables in marlin_template.h (#20236) · 9290de56
  周周周 authored Jul 02, 2025
  
  9290de56
01 Jul, 2025 2 commits
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
- [V1] [ROCm] Enable EP with AITER Fused MoE (#20270) · 02cabff2
  TJian authored Jul 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  02cabff2