Commits · af376ca19d4588b1d5ace72ffc0b4bbd778c15f2 · OpenDAS / vllm_cscc · GitLab

22 Jul, 2025 5 commits
- [Core] Minimize number of dict lookup in _maybe_evict_cached_block (#21281) · af376ca1
  Jialin Ouyang authored Jul 21, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  af376ca1
- Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334) · e7b20426
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  e7b20426
- [Intel GPU] Ray Compiled Graph avoid NCCL for Intel GPU (#21338) · 90f1e554
  Ratnam Parikh authored Jul 21, 2025
```
Signed-off-by: ratnampa <ratnam.parikh@intel.com>
```
  90f1e554
- [Doc] Fix CPU doc format (#21316) · 5e70dcd6
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  5e70dcd6
- [XPU] Enable external_launcher to serve as an executor via torchrun (#21021) · 25d585ab
  Chaojun Zhang authored Jul 22, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  25d585ab
21 Jul, 2025 18 commits
- [v1][sampler] Inplace logprobs comparison to get the token rank (#21283) · 8d0a01a5
  Lu Fang authored Jul 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d0a01a5
- [perf] Speed up align sum kernels (#21079) · 0ec82edd
  Himanshu Jaju authored Jul 21, 2025
```
Signed-off-by: Himanshu Jaju <hj@mistral.ai>
```
  0ec82edd
- Fix bad lm-eval fork (#21318) · 005ae9be
  Michael Goin authored Jul 21, 2025
  
  005ae9be
- [DP] Fix Prometheus Logging (#21257) · 29d1ffc5
  Robert Shaw authored Jul 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  29d1ffc5
- [Attention] Clean up iRoPE in V1 (#21188) · 304dce7e
  Lucas Wilkinson authored Jul 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  304dce7e
- [Misc] Add dummy maverick test (#21199) · 6ece16c4
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  6ece16c4
- [BugFix] make utils.current_stream thread-safety (#21252) (#21253) · a0e827e0
  simpx authored Jul 22, 2025
```
Signed-off-by: simpx <simpxx@gmail.com>
```
  a0e827e0
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
- [Misc] Add sliding window to flashinfer test (#21282) · 6dda13c8
  Woosuk Kwon authored Jul 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6dda13c8
- Add Nvidia ModelOpt config adaptation (#19815) · 6b46c4b6
  Zhiyu authored Jul 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  6b46c4b6
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
- [Docs] Make tables more space efficient in `supported_models.md` (#21291) · e6b90a28
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e6b90a28
- [Docs] Fix hardcoded links in docs (#21287) · be54a951
  Harry Mellor authored Jul 21, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  be54a951
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
- [Bugfix] Fix missing placeholder in logger debug (#21280) · 378d33c3
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  378d33c3
- Add the instruction to run e2e validation manually before release (#21023) · 940af1f0
  Huy Do authored Jul 20, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  940af1f0
- [Docs] Add RFC Meeting to Issue Template (#21279) · 92615d7f
  Simon Mo authored Jul 20, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  92615d7f
- [CI] Cleanup modelscope version constraint in Dockerfile (#21243) · 8188196a
  Kay Yan authored Jul 21, 2025
```
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  8188196a
20 Jul, 2025 5 commits
- [bugfix] fix syntax warning caused by backslash (#21251) · 7ba34b12
  Jiayi Yan authored Jul 21, 2025
  
  7ba34b12
- [Model] Support VLMs with transformers backend (#20543) · 9499e26e
  Raushan Turganbay authored Jul 20, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  9499e26e
- [Model] use AutoWeightsLoader for bart (#18299) · 51ba8395
  Calvin Chen authored Jul 20, 2025
```
Signed-off-by: calvin chen <120380290@qq.com>
```
  51ba8395
- Enable v1 metrics tests (#20953) · d1fb65bd
  Seiji Eicher authored Jul 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  d1fb65bd
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 12 commits
- [Docs] [V1] Update docs to remove enforce_eager limitation for hybrid models. (#21233) · 2b504eb7
  Thomas Parnell authored Jul 20, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  2b504eb7
- GLM-4 Update (#20736) · 10eb24cc
  Yuxuan Zhang authored Jul 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Lu Fang <fanglu@fb.com>
```
  10eb24cc
- [BugFix] Fix full cuda graph slot_mapping (#21228) · 2e8cbb58
  fhl2000 authored Jul 20, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  2e8cbb58
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12
- [Docs] Update the link to the 'Prometheus/Grafana' example (#21225) · 6a971ed6
  Jiayi Yan authored Jul 19, 2025
  
  6a971ed6
- [CI/CD][bugfix]fix: error argument to loads has incompatible type (#21223) · da6579bf
  Sungjae Lee authored Jul 19, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Signed-off-by: Sungjae Lee <sung-jae.lee@navercorp.com>
```
  da6579bf
- Fix/remove some broken model executor tests (#21224) · c81259d3
  Rabi Mishra authored Jul 19, 2025
```
Signed-off-by: Rabi Mishra <ramishra@redhat.com>
```
  c81259d3
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d
- [Bugfix][Frontend] Fix openai CLI arg `middleware` (#21220) · b3d82108
  22quinn authored Jul 19, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  b3d82108
- [NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645) · 6d0734c5
  Kaixi Hou authored Jul 19, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  6d0734c5