Commits · 2fd1a40a54cf9a5af6f0a8ce4700faf4a1a5108b · OpenDAS / vllm_cscc · GitLab

02 Sep, 2025 27 commits
- [CI/Build] Disable SiluMul NVFP4 quant fusion tests (#24121) · 2fd1a40a
  Matthew Bonanni authored Sep 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2fd1a40a
- [Bug] R1 Accuracy: Fix `routed_scaling_factor` Double Mul Issue (#24119) · 930a2414
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  930a2414
- [AMD][Kernel][Bugfix] Cast offsets tensor bn to tl.int64 to avoid GPU segfault (#23692) · 457e4719
  rasmith authored Sep 02, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  457e4719
- [CI] Enable all hf transformers baselines in test_hybrid (#23936) · d328f789
  Thomas Parnell authored Sep 02, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  d328f789
- [Log] Only Print Profiler Results on Rank 0 (#23370) · 98aee612
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  98aee612
- Fix weights loading for Apertus (#24100) · 598bd74c
  nathan authored Sep 02, 2025
```
Signed-off-by: Nathan Ranchin <nranchin@student.ethz.ch>
```
  598bd74c
- [Metrics] Deprecate TPOT in favor of ITL (#24110) · 24177984
  Mark McLoughlin authored Sep 02, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  24177984
- [Bugfix] Fix packed_factor missing attribute error (#23902) · 9480ae24
  Kyuyeun Kim authored Sep 02, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9480ae24
- Run ruff format on a few files. (#24075) · f399182e
  Chenheli Hua authored Sep 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  f399182e
- [Bugfix] Fix transform_config parsing in Compressed Tensors (#23945) · 1c413105
  Kyle Sayers authored Sep 02, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  1c413105
- [Benchmark] Add support for local hf dataset path in benchmark (#23999) · c83c4ff8
  Jiangyun Zhu authored Sep 03, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c83c4ff8
- [docs] add SYS_NICE cap & `security-opt` for docker/k8s (#24017) · 0e1759cd
  Peter Pan authored Sep 03, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0e1759cd
- [CI Failure] Skip failing nvfp4 silu test (#23959) · e66ed3e6
  Michael Goin authored Sep 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e66ed3e6
- [Model] Classification models support logit_bias / sigmoid_normalize (#24031) · e0653f6c
  wang.yuqi authored Sep 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  e0653f6c
- [BugFix] Fix EXAONE4 rotary embeddings (#23918) · 38ba061f
  Kyungmin Lee authored Sep 02, 2025
```
Signed-off-by: lkm2835 <lkm2835@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  38ba061f
- [Gemma3n] Fix audio batching (#24052) · 0a74e9d0
  Nicolò Lucchesi authored Sep 02, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0a74e9d0
- correct LWS deployment yaml (#23104) · 8bd58449
  Christian Berge authored Sep 02, 2025
```
Signed-off-by: cberge908 <42270330+cberge908@users.noreply.github.com>
```
  8bd58449
- [CI]: reduce HTTP calls inside entrypoints openai tests (#23646) · ce30dca5
  Aziz authored Sep 02, 2025
```
Signed-off-by: AzizCode92 <azizbenothman76@gmail.com>
Signed-off-by: Aziz <azizbenothman76@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ce30dca5
- [Model] Support dp on ViT on GLM-4.5V (#23168) · 2f0bab3f
  WeiQing Chen authored Sep 02, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  2f0bab3f
- [Doc]: fix typos in Python comments (#24077) · fad73be1
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fad73be1
- Migrate Interns1 inputs to TensorSchema (#23510) · 56d04089
  Benji Beck authored Sep 01, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  56d04089
- [XPU][Feature] fp8 online quantization support for XPU (#23148) · 7be0cb8e
  Yan Ma authored Sep 02, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Qiming Zhang <qiming1.zhang@intel.com>
```
  7be0cb8e
- Migrate OvisImagePatchInputs to TensorSchema (#22024) · 1fa1d6a9
  Benji Beck authored Sep 01, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  1fa1d6a9
- Remove runtime checks based on pooling params (#24051) · d59c9864
  Maximilien de Bayser authored Sep 02, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  d59c9864
- [Bugfix] Fix the issue that Blip2ForConditionalGeneration' object has… (#24028) · 04d0c607
  damon authored Sep 02, 2025
```
Signed-off-by: Dazhi Jiang <dazhi_jiang@163.com>
```
  04d0c607
- [V1][Mamba1] - FP32 SSM Kernel Support (#23506) · 2b41cbbf
  Asaf Joseph Gardin authored Sep 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  2b41cbbf
- [Doc]: fix typos in Python comments (#24042) · 0235103c
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0235103c
01 Sep, 2025 13 commits
- [bugfix]fix MTP hidden states (#24056) · a344a5aa
  Lucia Fang authored Sep 01, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  a344a5aa
- [Chore][V0 Deprecation] Move LogProb to a separate file (#24055) · 56853702
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  56853702
- [Model] Support DP for ViT on Kimi-VL-A3B-Thinking-2506 (#23817) · a0e0efd6
  WeiQing Chen authored Sep 02, 2025
```
Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  a0e0efd6
- [docs][misc] IOProcessor plugins fixes (#24046) · cf91a89d
  Christian Pinto authored Sep 01, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  cf91a89d
- [Misc] Minor code simplification for spec decode (#24053) · 39a22dca
  Woosuk Kwon authored Sep 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  39a22dca
- Document multi-proc method selection for profiling (#23802) · 41c80698
  Julien Debache authored Sep 01, 2025
```
Signed-off-by: jdebache <jdebache@nvidia.com>
```
  41c80698
- [Model]: support KeyeVL-1_5-8B (#23838) · 7c8271cd
  Kwai-Keye authored Sep 01, 2025
```
Signed-off-by: wangruitao <wangruitao@kuaishou.com>
Co-authored-by: wangruitao <wangruitao@kuaishou.com>
```
  7c8271cd
- [Doc]: Fix CPU install docs: force torch-backend=cpu to avoid GPU torchvision errors (#24033) · 3e330fcb
  Kay Yan authored Sep 01, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  3e330fcb
- [Frontend] Gemma3n audio `transcriptions`/`translations` endpoint (#23735) · d46934b2
  Nicolò Lucchesi authored Sep 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  d46934b2
- [Doc]: fix typos in Python comments (#24026) · 10728495
  Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  10728495
- [Kernel] Update DeepGEMM to latest commit (#23915) · dc1a5318
  Jee Jee Li authored Sep 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  dc1a5318
- [Frontend] Update the warning log when using VLLM_ALLOW_LONG_MAX_MODEL_LEN (#20904) · 55602bb2
  wang.yuqi authored Sep 01, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  55602bb2
- [Misc] Enable V1 FP16 inference on pre-Ampere GPUs (#24022) · d7fbc6dd
  Isotr0py authored Sep 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d7fbc6dd