Commits · c34963f13873d0919f9431ca5e7b21d03ae1c1e6 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "fe393be80b94f07bb7e1e141aa4136138a1f7795"

02 Mar, 2026 4 commits
- [ROCm][CI] Disable skinny GEMMs in language model standard tests to fix non-determinism (#35152) · c34963f1
  Andreas Karatzas authored Mar 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c34963f1
- [ROCm] add amd-quark package in requirements for rocm to use quantized models (#35658) · f26650d6
  Hongxia Yang authored Mar 02, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  f26650d6
- [XPU] fix mxfp4 activation type (#35691) · 92f5d0f0
  Kunshang Ji authored Mar 02, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  92f5d0f0
- Fix deprecated v1 config tests (#35327) · a60985b0
  Jesse Cai authored Mar 01, 2026
```
Signed-off-by: Jesse Cai <jessecai@fb.com>
```
  a60985b0
01 Mar, 2026 13 commits
- [Attention] FA4 integration (#32974) · 8b5014d3
  Lucas Wilkinson authored Mar 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8b5014d3
- Revert "[Bugfix] Disable TRTLLM attention with KV transfer enabled (#33192)" (#34832) · 57a96e26
  zhanqiuhu authored Mar 01, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  57a96e26
- [torch.compile] Undo the fast_moe_cold_start hack in torch>=2.11 (#35475) · e82fbeec
  Richard Zou authored Mar 01, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e82fbeec
- [Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256) · 62904708
  haosdent authored Mar 02, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  62904708
- [Model Runner V2] Use block table apis for capture inputs (#35671) · 72f4d162
  Woosuk Kwon authored Mar 01, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  72f4d162
- fix(mxfp4): return is_monolithic=False when LoRA is enabled for Triton backend (#35382) · 5a435507
  Seungho Yoon authored Mar 01, 2026
```
Signed-off-by: Seungho Yoon <yoonsnowdev@gmail.com>
```
  5a435507
- [MISC] Fixing a null reference by removing parallel_utils from mypy EXCLUDE (#35630) · 59d7af9c
  Taneem Ibrahim authored Mar 01, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  59d7af9c
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
- [Model Runner V2] Minor refactoring for EncoderRunner (#35628) · da543d1a
  Woosuk Kwon authored Mar 01, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  da543d1a
- [AMD][CI] Support Triton attention with ExampleConnector (#34931) · 87d319c5
  Ryan Rock authored Mar 01, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  87d319c5
- Fix typo: implictly -> implicitly in isaac.py docstring (#35646) · a9ec392c
  lin-shh authored Mar 01, 2026
  
  a9ec392c
- [Bugfix][Model] Fix Qwen3.5/Qwen3Next ignoring --dtype flag on older GPUs (#35617) · afd089f2
  lailoo authored Mar 01, 2026
  
  afd089f2
- Add TMA support to fused_moe_lora kernel (#32195) · 3ecd0bf9
  gnovack authored Feb 28, 2026
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  3ecd0bf9
28 Feb, 2026 23 commits
- [Model Runner V2] Add ModelStateInterface [4/N] (#35621) · e3eb146f
  Woosuk Kwon authored Feb 28, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  e3eb146f
- [Bugfix] Fix Anthropic API base64 image handling in Messages endpoint (#35557) · 95a395db
  Martin Vit authored Feb 28, 2026
```
Signed-off-by: Martin Vit <martin@voipmonitor.org>
```
  95a395db
- [Chore] Cleanup BNB utilization dead code (#35620) · e94b263b
  Isotr0py authored Mar 01, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e94b263b
- [Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301
  Wentao Ye authored Feb 28, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e113a301
- [Benchmark] Avoid unnecessary video download in MMVU (#35618) · 1dafb29f
  Cyrus Leung authored Mar 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1dafb29f
- [Fix] Avoid sending image input to other PP ranks (#35405) · 49b9ae32
  emricksini-h authored Feb 28, 2026
```
Signed-off-by: emricksini-h <emrick.birivoutin@hcompany.ai>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  49b9ae32
- Fix Qwen3_5MTP packed_modules_mapping for gate_up_proj (#35581) · 63d7972f
  cwazai authored Feb 28, 2026
  
  63d7972f
- custom dataset img support base64 (#35280) · c68e69f1
  flutist authored Feb 28, 2026
```
Signed-off-by: xjx <493337577@qq.com>
```
  c68e69f1
- [Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) · 7e08c22b
  Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  7e08c22b
- add io_process_plugin for sparse embedding (#34214) · 8e75d885
  Augusto Yao authored Feb 28, 2026
```
Signed-off-by: augusto.yjh <augusto.yjh@antgroup.com>
Signed-off-by: Augusto Yao <augusto.yjh@antgroup.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  8e75d885
- [Feature]Supports Anthropic Thinking Block (#33671) · 0892d1ab
  Mario Hong authored Feb 28, 2026
```
Signed-off-by: mariohong <mariohong128@gmail.com>
Co-authored-by: zetaohong <i-hongzetao@stepfun.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0892d1ab
- Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
  Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  7600642e
- [ROCm][CI] Parametrize vision score tests across attention backends with... · 1e69c048
  Andreas Karatzas authored Feb 28, 2026
```
[ROCm][CI] Parametrize vision score tests across attention backends with per-backend tolerances (#35571)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  1e69c048
- [Benchmark] Improve UX of sweep scripts (#35600) · 4292e3b8
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4292e3b8
- [Benchmark] Rename SLA Finder to Workload Explorer (#35586) · 24d6ea8a
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24d6ea8a
- [Misc] Change logging level from info to debug for tool parser import (#35575) · 57c86c07
  Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  57c86c07
- [CI] add trainer_send_weights for MockWeightTransferEngine (#35589) · 06254d4c
  Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  06254d4c
- [ROCm][CI] Expose tests to AMD production CI and fix amdsmi heap corruption (#35071) · f5d1281c
  Andreas Karatzas authored Feb 27, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f5d1281c
- [ROCm] Derive device capability from GCN arch string without CUDA init (#35069) · 94029ffa
  Andreas Karatzas authored Feb 27, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  94029ffa
- [ROCm][CI] Adding infiniband mappings for moriio tests (#35170) · 88e8525f
  Andreas Karatzas authored Feb 27, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  88e8525f
- [EPLB] Enforce sync eplb for NCCL-based all2all backend (#35212) · b2d8b422
  Ilya Markov authored Feb 28, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  b2d8b422
- [Bugfix] Move chat completion response_format validation to Pydantic model_validator (#35510) · 1d5ab5d6
  Umut Polat authored Feb 28, 2026
```
Signed-off-by: umut-polat <52835619+umut-polat@users.noreply.github.com>
```
  1d5ab5d6
- [Bugfix] Propagate compilation_time from workers to main process for TP>1 (#35503) · 7b346ba8
  Huy Do authored Feb 27, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  7b346ba8