Commits · c55c02899853a31b1a8a0f48b2ca3ea9dae80586 · OpenDAS / vllm_cscc · GitLab

24 Aug, 2025 1 commit
- [gpt-oss] Streaming Output for Python Tool (#23409) · c55c0289
  Jiangyun Zhu authored Aug 24, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c55c0289
23 Aug, 2025 10 commits
- [Misc] Modify CacheConfig import (#23459) · 65197a5f
  Jee Jee Li authored Aug 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  65197a5f
- Support DeepSeek-V3.1 tool call (#23454) · b8f17f5d
  Xu Wenqing authored Aug 23, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  b8f17f5d
- fix(tests): Correct unreachable assertion in truncation test (#23425) · d9a55204
  Aziz authored Aug 23, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
```
  d9a55204
- Revert "[PERF] Use faster way of decode in tokenizer: avoid useless... · b4e9fd81
  Cyrus Leung authored Aug 23, 2025
```
Revert "[PERF] Use faster way of decode in tokenizer: avoid useless list-to-list conversion (#20000)" (#23396)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b4e9fd81
- Add glm4.5v tp2,4 fp8 config on H100_80GB (#23443) · 308fa287
  Chenxi Yang authored Aug 22, 2025
```
Co-authored-by: Chenxi Yang <cxyang@meta.com>
```
  308fa287
- Quantization: support FP4 quantized models on AMD CDNA2/CDNA3 GPUs (#22527) · fa78de9d
  Daifeng Li authored Aug 23, 2025
```
Signed-off-by: feng <fengli1702@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  fa78de9d
- [UX] Move Dockerfile DeepGEMM install to tools/install_deepgemm.sh (#23360) · f6818a92
  Michael Goin authored Aug 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f6818a92
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
- [BugFix] Fix `MinPLogitsProcessor.update_states()` (#23401) · add1adfe
  Nick Hill authored Aug 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  add1adfe
- [BugFix] Fix batch updates for pooling models (#23398) · c80c53a3
  Nick Hill authored Aug 22, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c80c53a3
22 Aug, 2025 29 commits
- [NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703) · 24d0c9e6
  elvischenv authored Aug 23, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  24d0c9e6
- [BugFix][AMD][Quantization] Fix torch.compile issue where wvSplitKQ not being... · cc7ae5e7
  rasmith authored Aug 22, 2025
```
[BugFix][AMD][Quantization] Fix torch.compile issue where wvSplitKQ not being called when it should when using quantized FP8 model (#22281)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  cc7ae5e7
- [PERF] PyTorch Symmetric Memory All-Reduce (#20759) · 0313cf85
  Ilya Markov authored Aug 22, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0313cf85
- [CI/Build] add EP dependencies to docker (#21976) · 0483fabc
  Zhewen Li authored Aug 22, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  0483fabc
- add an env var for path to pre-downloaded flashinfer cubin files (#22675) · da65bec3
  Shiyan Deng authored Aug 22, 2025
  
  da65bec3
- [Quantization] Allow GGUF quantization to skip unquantized layer (#23188) · 4645024d
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4645024d
- [Bugfix] Fix broken Florence-2 model (#23426) · cd7a3df2
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  cd7a3df2
- [Model] Add Ovis2.5 PP support (#23405) · 32d2b406
  Isotr0py authored Aug 23, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32d2b406
- [Doc]: fix various typos in multiple files (#23179) · 22cf679a
  Didier Durand authored Aug 22, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  22cf679a
- Add unit tests for batched guided and non-guided requests (#23389) · b6d7d34f
  Yong Hoon Shin authored Aug 22, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  b6d7d34f
- fix(tests): Ensure reliable CUDA cache clearing in MoE test (#23416) · 341923b9
  Aziz authored Aug 22, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  341923b9
- [BugFix] Fix the issue where image embeddings were incorrectly split.… (#23366) · 424fb7a5
  bppps authored Aug 23, 2025
```
Signed-off-by: bppps <bpppsaka@gmail.com>
Co-authored-by: zouyu.zzx <zouyu.zzx@alibaba-inc.com>
Co-authored-by: bppps <bpppsaka@gmail.com>
```
  424fb7a5
- [Speculators][Speculative Decoding] Fix Qwen 2 Eagle3 Support (#23337) · 88491c1b
  PapaGoose authored Aug 22, 2025
  
  88491c1b
- [Bugfix]: Installing dev environment due to pydantic incompatible version (#23353) · 613a23b5
  Martin Hickey authored Aug 22, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  613a23b5
- [Fix] Bump triton version in rocm-build requirements (#21630) · 51a21530
  Burkhard Ringlein authored Aug 22, 2025
```
Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
```
  51a21530
- [Bug fix] Dynamically setting the backend variable for genai_perf_tests in the... · ebe14621
  Naman Lalit authored Aug 22, 2025
```
[Bug fix] Dynamically setting the backend variable for genai_perf_tests in the run-nightly-benchmark script (#23375)
Signed-off-by: Naman Lalit <nl2688@nyu.edu>
```
  ebe14621
- [Misc] local import code clean (#23420) · 325aa3de
  Ning Xie authored Aug 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  325aa3de
- [Doc] Update the doc for log probs + prefix caching (#23399) · a073be6d
  Chen Zhang authored Aug 22, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a073be6d
- [misc] Remove outdate comment about runai_model_streamer (#23421) · 695e7adc
  杨朱 · Kiki authored Aug 22, 2025
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
```
  695e7adc
- [Attention] Allow V1 flash_attn to support cross-attention (#23297) · 281710ef
  Russell Bryant authored Aug 22, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  281710ef
- [Misc] Move M-RoPE init logic to _init_mrope_positions (#23422) · 808d2e9a
  Woosuk Kwon authored Aug 22, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  808d2e9a
- [V0 Deprecation] Remove V0 LoRA test (#23418) · 285178b3
  Jee Jee Li authored Aug 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  285178b3
- [Bugfix] Fix pooling models on CPU backend (#23392) · 88016c37
  Li, Jiang authored Aug 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  88016c37
- Migrate MiniCPMOAudioInputs to TensorSchema (#21847) · 99872085
  Benji Beck authored Aug 22, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  99872085
- [gpt-oss] add input/output usage in responses api when harmony context is leveraged (#22667) · 0ba1b54a
  Guillaume Calmettes authored Aug 22, 2025
```
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
```
  0ba1b54a
- [P/D][Nixl] Make kv cache register compatible with hybrid memory allocator (#23079) · 53415653
  Flora Feng authored Aug 21, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  53415653
- [Attention] Refactor AttentionMetadata Preparation for Encoder-only Models (#23154) · 17373dcd
  Chen Zhang authored Aug 21, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  17373dcd
- [New Model] Add Seed-Oss model (#23241) · 59640693
  Bin Jia authored Aug 22, 2025
```
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  59640693
- [Misc] Add gemma3 chat template with pythonic-style function calling (#17149) · de9c085e
  Philip Chung authored Aug 21, 2025
```
Signed-off-by: Philip Chung <philip.f.chung@gmail.com>
```
  de9c085e