Commits · 8f2720def9c32163822d9ccf9a31019f7a892e12 · OpenDAS / vllm_cscc · GitLab

10 Jul, 2025 4 commits
- [Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629) · 8f2720de
  Chauncey authored Jul 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  8f2720de
- Correct PPMissingLayer handling in Deepseek-V2-Lite PP deployment (#20665) · ad6c2e1a
  Seiji Eicher authored Jul 09, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  ad6c2e1a
- Use NVCC `--compress-mode` to reduce binary size by 30% (#20694) · 49e8c7ea
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  49e8c7ea
- [Misc] DP : Add ExpertTokensMetadata (#20332) · 805d62ca
  Varun Sundar Rabindranath authored Jul 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  805d62ca
09 Jul, 2025 33 commits
- [CI/Build] Fix FlashInfer double build in Dockerfile (#20651) · b7d9e941
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b7d9e941
- [Misc] Simplify the prefix caching logic on draft tokens (#20701) · 7c12a765
  Woosuk Kwon authored Jul 09, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7c12a765
- [BugFix]: Properly set engine_id when using multi connector (#19487) · cd587c93
  Yiming authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: leiyiming <leiyiming@kingsoft.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  cd587c93
- [Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1
  fxmarty-amd authored Jul 09, 2025
```
Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>
```
  332d4cb1
- [Kernel] Add Conch backend for mixed-precision linear layer (#19818) · bf03ff35
  Jacob Manning authored Jul 09, 2025
```
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
```
  bf03ff35
- [Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6
  Tuan, Hoang-Trong authored Jul 09, 2025
```
Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  47043eb6
- Support Llama 4 for cutlass_moe_fp4 (#20453) · 31b96d1c
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  31b96d1c
- [CI/Build] Enlarge tolerance for a CPU multi-modal test (#20684) · e59ba9e1
  Li, Jiang authored Jul 10, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e59ba9e1
- Remove heading form installation `inc.md` file (#20697) · 403b4815
  Harry Mellor authored Jul 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  403b4815
- [Doc] Update CPU doc (#20676) · 138709f8
  Li, Jiang authored Jul 10, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  138709f8
- [Bench] Add NVFP4 GEMM benchmark script (#20578) · 0bbac1c1
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0bbac1c1
- [XPU][CI] enhance xpu test support (#20652) · a3e4e85e
  Liangliang Ma authored Jul 10, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: zhenwei-intel <zhenweiliu@habana.ai>
```
  a3e4e85e
- [TPU][Bugfix] fix test_pallas (#20666) · eb58f595
  Chengji Yao authored Jul 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  eb58f595
- [Bugfix] Fix handling of Tensorizer arguments for LoadConfig (#20643) · 4ac9c33f
  Sanger Steel authored Jul 09, 2025
```
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  4ac9c33f
- [doc] update doc format (#20673) · efe73d05
  Reid authored Jul 09, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  efe73d05
- [Docs] Improve docs for RLHF co-location example (#20599) · 853487bc
  Ricardo Decal authored Jul 09, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  853487bc
- [Benchmark] Parameterization of streaming loading of multimodal datasets (#20528) · 9ff2af6d
  Li Wang authored Jul 09, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  9ff2af6d
- [Doc] Update notes (#20668) · 70ca5484
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  70ca5484
- [V1] [Doc] Update V1 docs for Mamba models (#20499) · 5358cce5
  Thomas Parnell authored Jul 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  5358cce5
- [Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is... · 2155e95e
  Chauncey authored Jul 09, 2025
```
[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is enabled and `tool_choice` is set to `'required'`. (#20662)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2155e95e
- [Docs] fix minimax tool_calling docs error (#20667) · f95570a5
  qscqesze authored Jul 09, 2025
```
Signed-off-by: qingjun <qingjun@minimaxi.com>
```
  f95570a5
- [Intel GPU] support ray as distributed executor backend for XPU. (#20659) · b6e7e3d5
  Kunshang Ji authored Jul 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b6e7e3d5
- [XPU] Use spawn with XPU multiprocessing (#20649) · e760fcef
  Dmitry Rogozhkin authored Jul 09, 2025
```
Signed-off-by: Dmitry Rogozhkin <dmitry.v.rogozhkin@intel.com>
```
  e760fcef
- [Misc] Fix the size of batched_dummy_mm_inputs in profile_run (#20434) · 6bbf1795
  B-201 authored Jul 09, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  6bbf1795
- Fix bullets in incremental_build.md (#20642) · 9e0ef888
  Michael Goin authored Jul 09, 2025
  
  9e0ef888
- [feat] enable SM100 CUTLASS block scaled group gemm for smaller batch sizes (#20640) · 97abeb1d
  Duncan Moss authored Jul 08, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  97abeb1d
- [Bugfix] set default set cuda_graph_sizes to min(self.max_num_seqs * 2, 512) (#20628) · 34dad19e
  zhrrr authored Jul 09, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  34dad19e
- [Hardware][PPC64LE] Enable V1 for ppc64le and ARM (#20554) · 6db31e7a
  Akash kaothalkar authored Jul 09, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
  6db31e7a
- [Docs] Improve documentation for multi-node service helper script (#20600) · 977180c9
  Ricardo Decal authored Jul 08, 2025
```
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
```
  977180c9
- [BugFix][Intel GPU] Use refactored API for dist_backend in V1 worker (#20596) · c40784c7
  Ratnam Parikh authored Jul 08, 2025
```
Signed-off-by: ratnampa <ratnam.parikh@intel.com>
```
  c40784c7
- [tech debt] Revisit lora request model checker (#20636) · baed180a
  kourosh hakhamaneshi authored Jul 08, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  baed180a
- [misc]refactor `Platform.set_device` method (#20262) · 0b407479
  Kunshang Ji authored Jul 09, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  0b407479
- Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang... · 5eaf5700
  Wenxin Cheng authored Jul 08, 2025
```
Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang Template Parameter Issue (#20142)
Signed-off-by: Lu Fang <lufang@fb.com>
```
  5eaf5700
08 Jul, 2025 3 commits
- [TPU][Bugfix] disable phi-3 test (#20632) · d8ee5a2c
  QiliangCui authored Jul 08, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  d8ee5a2c
- [Bugfix] Fix GLM-4.1-V video prompt update (#20635) · b9fca832
  Isotr0py authored Jul 09, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  b9fca832
- [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630) · 32dffc27
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32dffc27