Commits · 9de25c294b92e42a12d1fbbb3ab3f633fa80291c · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "6640dc0b603ea325745b4db3c17205659cb2048d"

27 Aug, 2025 14 commits
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
- [Quantization] Expand compressed-tensors MoE matching logic to support NFP4 + FP8 MoEs (#22674) · d272415e
  Dipika Sikka authored Aug 27, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  d272415e
- [Frontend] Optimize beam search performance by limiting concurrency (#23599) · 142ac080
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  142ac080
- [Frontend] Add --log-error-stack to print stack trace for error response (#22960) · 32102644
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  32102644
- [Model] Add Ernie4.5 VL Model Support (#22514) · 644d57d5
  CSWYF3634076 authored Aug 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  644d57d5
- [Core] Asynchronous h2d in merge_multimodal_embeddings via pinned memory. (#23686) · c905684c
  Chenheli Hua authored Aug 26, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  c905684c
- [Bugfix]: Qwen3 Coder Tool Parser (#23099) · 78683580
  Yiheng Xu authored Aug 27, 2025
```
Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
```
  78683580
- [Bugfix][gpt-oss] passing the cache config in gpt-oss (#23613) · fecbb7c7
  Wei authored Aug 26, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
  fecbb7c7
- [Bugfix] Lazy import gpt_oss_triton_kernels_moe for mxfp4 (#23678) · de02b07d
  Michael Goin authored Aug 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  de02b07d
- [quantization] use channel scales for w4a8 + misc fixes (#23570) · 2c2b140a
  czhu-cohere authored Aug 26, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  2c2b140a
- fix pynccl reduce_scatter (#23648) · c7c80af0
  yzds authored Aug 27, 2025
```
Co-authored-by: hongchao <hongchao@msh.team>
```
  c7c80af0
- [Feature][Responses API] Support MCP tool in background mode (#23494) · 6891205b
  wuhang authored Aug 27, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  6891205b
- feat: add triton fused moe config for GLM-4.5-Air-FP8 on B200 (#23695) · b1625dbe
  zixuanzhang226 authored Aug 26, 2025
```
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
```
  b1625dbe
- [Bugfix] UnboundLocalError when GptOss reasoning specified (#23054) · 585e0bde
  Federico authored Aug 27, 2025
```
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
```
  585e0bde
26 Aug, 2025 26 commits
- [V1] [Hybrid] Enable Full CUDA graph by default for hybrid models in V1 (#22594) · 5f1af97f
  Thomas Parnell authored Aug 27, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  5f1af97f
- [V1][P/D]P2pNcclConnector supports flashinfer (#23536) · c3b0fd1e
  Zhonghua Deng authored Aug 27, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3b0fd1e
- [Model] Enable video support for InternVL3.5 models (#23658) · 9816b81f
  Isotr0py authored Aug 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9816b81f
- [Bugfix] Fix incorrect original shape in hashing (#23672) · 9715f7bb
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  9715f7bb
- [v1] Add cross-attention KV cache support for encoder-decoder models (#23664) · 98aa16ff
  Russell Bryant authored Aug 26, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  98aa16ff
- [Docs] Fix warnings in `mkdocs build` (#23649) · 730d0ac8
  Hyogeun Oh (오효근) authored Aug 27, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  730d0ac8
- [Bugfix] Fix cuda event usage with CPU model runner (#23643) · 9b018700
  Li, Jiang authored Aug 27, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  9b018700
- [Misc] Add override for allreduce fusion thresholds (#23639) · 7ea22e42
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
```
  7ea22e42
- [model] support qwen2audio embedding input (#23625) · 9d4183dd
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  9d4183dd
- [Bugfix] fix bf16 multimodal model hash (#23623) · 513298f1
  Yuekai Zhang authored Aug 26, 2025
```
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  513298f1
- [Docs] Reduce requirements for docs build (#23651) · 379f828f
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  379f828f
- [CPU] add cpu fused moe pytorch native implementation (#23146) · f58675bf
  TianyuLi0 authored Aug 26, 2025
```
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  f58675bf
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
- [Kernel] Added flashinfer fp8 per-tensor gemms (#22895) · f66673a3
  nvjullin authored Aug 26, 2025
```
Signed-off-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f66673a3
- Support FlashAttention Backend for Hybrid SSM Models (#23299) · 2b4fc9bd
  Chen Zhang authored Aug 26, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  2b4fc9bd
- feat: add usage to TranscriptionResponse (text and json response_format) (#23576) · ebd5a77b
  Guillaume Calmettes authored Aug 26, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  ebd5a77b
- [Bugfix] Add missing enable_log_outputs parameter to init_app_state function (#23634) · 384dd1b0
  Matúš Námešný authored Aug 26, 2025
```
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
```
  384dd1b0
- [Model] fix DeepSeek e_score_correction_bias dtype to fp32 (#23640) · fdeb3dac
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  fdeb3dac
- [Perf] Remove duplicated NVFP4 blockscales to save memory (#23379) · d52358c1
  Michael Goin authored Aug 26, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d52358c1
- Fix writing benchmark results with tuple keys (#23633) · 6ace2f72
  Huy Do authored Aug 26, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  6ace2f72
- Fix nits from #20059 (#23548) · b00e69f8
  Harry Mellor authored Aug 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b00e69f8
- [V1] Enable V1 for compute capability < 8.0 + FP32 (#23614) · 50fede66
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  50fede66
- [Bugfix] Fix scheduling when repeated images in one request (#23544) · b5d34af3
  Roger Wang authored Aug 26, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
```
  b5d34af3
- [Bugfix] Fix Qwen25VL packed_modules_mapping (#23604) · 9b5f6423
  Jee Jee Li authored Aug 26, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  9b5f6423
- [Benchmarks] add benchmark for embedding models (#23000) · 3ecbb14b
  Jiangyun Zhu authored Aug 26, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3ecbb14b
- [mypy] Fix incorrect type hint for EAGLE3 support (#23617) · 7d67a9d9
  Cyrus Leung authored Aug 26, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d67a9d9