Commits · 28f350e147c4b5c050c0080ef0d924c15ab87635 · OpenDAS / vllm_cscc · GitLab

03 Sep, 2025 13 commits
- Support add_generation_prompt in embeddings endpoint with chat request (#23931) · 28f350e1
  Jakub Smid authored Sep 03, 2025
```
Signed-off-by: biba10 <jaksmid@seznam.cz>
```
  28f350e1
- [Misc] Clean up deadcode for legacy processing pipeline (#24153) · 9c99e487
  Isotr0py authored Sep 03, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9c99e487
- [CI/Build] Serve images used by multimodal tests through local HTTP Server (#23907) · 70549c12
  dsinghvi authored Sep 03, 2025
```
Signed-off-by: Divyansh Singhvi <divyanshsinghvi@gmail.com>
Signed-off-by: dsinghvi <divyanshsinghvi@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  70549c12
- [Nixl] Heterogeneous TP support FlashInfer (#20189) · f0c503f6
  Nicolò Lucchesi authored Sep 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f0c503f6
- [distributed][rl] remove nccl cumem env var override (#24141) · f38035c1
  youkaichao authored Sep 03, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f38035c1
- [BugFix] Fix routed_scaling_factor double mul for dots1 and glm4 MoE models (#24132) · 426cc862
  Yong Hoon Shin authored Sep 02, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  426cc862
- [Misc] Add check for dual_chunk_attention (#24070) · e81d4e69
  Jiangyun Zhu authored Sep 03, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  e81d4e69
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
- [Doc]: fix typos in Python comments (#24093) · d7e1e599
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d7e1e599
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
- [V1] Wrapper which plumbs request-level logits processors into vLLM... · 136d853e
  afeldman-nm authored Sep 02, 2025
```
[V1] Wrapper which plumbs request-level logits processors into vLLM batch-level logits processing (#23656)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  136d853e
- Upgrade xgrammar to 0.1.23 (#22988) · e32a0e86
  Russell Bryant authored Sep 02, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  e32a0e86
- [XPU] Fix the bug of LoRA logits on the XPU platform (#24081) · 862f2ef8
  Chaojun Zhang authored Sep 03, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  862f2ef8
02 Sep, 2025 20 commits
- [Bug] R1 Accuracy: Fix `routed_scaling_factor` Double Mul Issue (#24119) · 930a2414
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  930a2414
- [AMD][Kernel][Bugfix] Cast offsets tensor bn to tl.int64 to avoid GPU segfault (#23692) · 457e4719
  rasmith authored Sep 02, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  457e4719
- [Log] Only Print Profiler Results on Rank 0 (#23370) · 98aee612
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  98aee612
- Fix weights loading for Apertus (#24100) · 598bd74c
  nathan authored Sep 02, 2025
```
Signed-off-by: Nathan Ranchin <nranchin@student.ethz.ch>
```
  598bd74c
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- [Bugfix] Fix packed_factor missing attribute error (#23902) · 9480ae24
  Kyuyeun Kim authored Sep 02, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9480ae24
- Run ruff format on a few files. (#24075) · f399182e
  Chenheli Hua authored Sep 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  f399182e
- [Bugfix] Fix transform_config parsing in Compressed Tensors (#23945) · 1c413105
  Kyle Sayers authored Sep 02, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  1c413105
- [Benchmark] Add support for local hf dataset path in benchmark (#23999) · c83c4ff8
  Jiangyun Zhu authored Sep 03, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c83c4ff8
- [Model] Classification models support logit_bias / sigmoid_normalize (#24031) · e0653f6c
  wang.yuqi authored Sep 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  e0653f6c
- [BugFix] Fix EXAONE4 rotary embeddings (#23918) · 38ba061f
  Kyungmin Lee authored Sep 02, 2025
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  38ba061f
- [Gemma3n] Fix audio batching (#24052) · 0a74e9d0
  Nicolò Lucchesi authored Sep 02, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0a74e9d0
- [Model] Support dp on ViT on GLM-4.5V (#23168) · 2f0bab3f
  WeiQing Chen authored Sep 02, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  2f0bab3f
- Migrate Interns1 inputs to TensorSchema (#23510) · 56d04089
  Benji Beck authored Sep 01, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  56d04089
- [XPU][Feature] fp8 online quantization support for XPU (#23148) · 7be0cb8e
  Yan Ma authored Sep 02, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  7be0cb8e
- Migrate OvisImagePatchInputs to TensorSchema (#22024) · 1fa1d6a9
  Benji Beck authored Sep 01, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  1fa1d6a9
- Remove runtime checks based on pooling params (#24051) · d59c9864
  Maximilien de Bayser authored Sep 02, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  d59c9864
- [Bugfix] Fix the issue that Blip2ForConditionalGeneration' object has… (#24028) · 04d0c607
  damon authored Sep 02, 2025
```
Signed-off-by: Dazhi Jiang <dazhi_jiang@163.com>
```
  04d0c607
- [V1][Mamba1] - FP32 SSM Kernel Support (#23506) · 2b41cbbf
  Asaf Joseph Gardin authored Sep 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  2b41cbbf
- [Doc]: fix typos in Python comments (#24042) · 0235103c
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0235103c
01 Sep, 2025 7 commits
- [bugfix]fix MTP hidden states (#24056) · a344a5aa
  Lucia Fang authored Sep 01, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  a344a5aa
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
- [Model] Support DP for ViT on Kimi-VL-A3B-Thinking-2506 (#23817) · a0e0efd6
  WeiQing Chen authored Sep 02, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  a0e0efd6
- [docs][misc] IOProcessor plugins fixes (#24046) · cf91a89d
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  cf91a89d
- [Misc] Minor code simplification for spec decode (#24053) · 39a22dca
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  39a22dca
- [Model]: support KeyeVL-1_5-8B (#23838) · 7c8271cd
  Kwai-Keye authored Sep 01, 2025
```
Signed-off-by: wangruitao <wangruitao@kuaishou.com>
Co-authored-by: wangruitao <wangruitao@kuaishou.com>
```
  7c8271cd
- [Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735) · d46934b2
  Nicolò Lucchesi authored Sep 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d46934b2