Commits · 6b46c4b653d1d730a9b75d32b59b9d60f879b9d7 · OpenDAS / vllm_cscc · GitLab

21 Jul, 2025 9 commits
- Add Nvidia ModelOpt config adaptation (#19815) · 6b46c4b6
  Zhiyu authored Jul 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  6b46c4b6
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
- [Docs] Make tables more space efficient in `supported_models.md` (#21291) · e6b90a28
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6b90a28
- [Docs] Fix hardcoded links in docs (#21287) · be54a951
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be54a951
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
- [Bugfix] Fix missing placeholder in logger debug (#21280) · 378d33c3
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  378d33c3
- Add the instruction to run e2e validation manually before release (#21023) · 940af1f0
  Huy Do authored Jul 20, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  940af1f0
- [Docs] Add RFC Meeting to Issue Template (#21279) · 92615d7f
  Simon Mo authored Jul 20, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  92615d7f
- [CI] Cleanup modelscope version constraint in Dockerfile (#21243) · 8188196a
  Kay Yan authored Jul 21, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  8188196a
20 Jul, 2025 5 commits
- [bugfix] fix syntax warning caused by backslash (#21251) · 7ba34b12
  Jiayi Yan authored Jul 21, 2025
  
  7ba34b12
- [Model] Support VLMs with transformers backend (#20543) · 9499e26e
  Raushan Turganbay authored Jul 20, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  9499e26e
- [Model] use AutoWeightsLoader for bart (#18299) · 51ba8395
  Calvin Chen authored Jul 20, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  51ba8395
- Enable v1 metrics tests (#20953) · d1fb65bd
  Seiji Eicher authored Jul 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  d1fb65bd
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 26 commits
- [Docs] [V1] Update docs to remove enforce_eager limitation for hybrid models. (#21233) · 2b504eb7
  Thomas Parnell authored Jul 20, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  2b504eb7
- GLM-4 Update (#20736) · 10eb24cc
  Yuxuan Zhang authored Jul 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>
```
  10eb24cc
- [BugFix] Fix full cuda graph slot_mapping (#21228) · 2e8cbb58
  fhl2000 authored Jul 20, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  2e8cbb58
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12
- [Docs] Update the link to the 'Prometheus/Grafana' example (#21225) · 6a971ed6
  Jiayi Yan authored Jul 19, 2025
  
  6a971ed6
- [CI/CD][bugfix]fix: error argument to loads has incompatible type (#21223) · da6579bf
  Sungjae Lee authored Jul 19, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
```
  da6579bf
- Fix/remove some broken model executor tests (#21224) · c81259d3
  Rabi Mishra authored Jul 19, 2025
```
Signed-off-by: Rabi Mishra <ramishra@redhat.com>
```
  c81259d3
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
- [Bugfix][Frontend] Fix openai CLI arg `middleware` (#21220) · b3d82108
  22quinn authored Jul 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b3d82108
- [NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645) · 6d0734c5
  Kaixi Hou authored Jul 19, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  6d0734c5
- Add torch golden impl for moe_align_block_size kernel test (#20653) · 7d945771
  shixianc authored Jul 19, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>
```
  7d945771
- [BugFix] Fix potential cuda-graph IMA (#21196) · 59f93530
  Lucas Wilkinson authored Jul 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  59f93530
- [Bugfix] Fix ndarray video color from VideoAsset (#21064) · 18e519ec
  Isotr0py authored Jul 19, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  18e519ec
- [V0 deprecation] Remove long context LoRA (#21169) · 1eaff278
  Jee Jee Li authored Jul 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1eaff278
- Fix a couple of Voxtral tests (#21218) · cf8cc326
  Huy Do authored Jul 19, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  cf8cc326
- [Misc][Tools][Benchmark] Add readme file for auto_tune script (#20779) · 3a2cb264
  Chenyaaang authored Jul 19, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  3a2cb264
- [Model] EXAONE 4.0 model support (#21060) · 3e04107d
  김종곤 authored Jul 19, 2025
```
Signed-off-by: Deepfocused <rlawhdrhs27@gmail.com>
Signed-off-by: woongsik <rlawhdrhs27@gmail.com>
```
  3e04107d
- [Bug] DeepGemm: Fix TypeError: per_block_cast_to_fp8() missing 1 required... · 37bd8d6e
  Wentao Ye authored Jul 19, 2025
```
[Bug] DeepGemm: Fix TypeError: per_block_cast_to_fp8() missing 1 required positional argument: 'use_ue8m0' for SM100 (#21187)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  37bd8d6e
- [BugFix][CPU] Fix `TorchSDPABackendImpl` doesn't have `use_irope` (#21200) · 468e2400
  Lucas Wilkinson authored Jul 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  468e2400
- [Kernel][Performance] Tweak MoE Batched silu_mul_fp8_quant_deep_gemm kernel (#21193) · dcc6cfb9
  Varun Sundar Rabindranath authored Jul 19, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  dcc6cfb9
- [V0 Deprecation] Remove V0 Spec Decode workers (#21152) · dd572c0a
  Woosuk Kwon authored Jul 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dd572c0a
- [Bugfix][Model] Fix LoRA for Mistral-Small-3.1-24B-Instruct-2503 (#21183) · 9ffe905a
  Varun Sundar Rabindranath authored Jul 19, 2025
```
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
```
  9ffe905a
- [Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14
  Lucia Fang authored Jul 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>
```
  9a9fda14
- [Quantization] Enable BNB support for more MoE models (#21100) · 466e878f
  Jee Jee Li authored Jul 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  466e878f