Commits · 4719460644b4629db2b6dbf12be331d0b34b4b6f · OpenDAS / vllm_cscc · GitLab

19 Jun, 2025 16 commits
- Fixing Chunked Prefill Test. (#19762) · 47194606
  Alexei-V-Ivanov-AMD authored Jun 19, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  47194606
- [Frontend] Add optional token-level progress bar to `LLM.beam_search` (#19301) · 466166dc
  NekoMimiUnagi authored Jun 19, 2025
```
Signed-off-by: Ruosen Li <rxl190028@utdallas.edu>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Ubuntu <ubuntu@ip-172-31-71-179.ec2.internal>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  466166dc
- Add xLAM tool parser support (#17148) · 1d0ae26c
  Zuxin authored Jun 18, 2025
  
  1d0ae26c
- [Minor] Allow redirecting model path for HfRunner in test (#19795) · 60219995
  Isotr0py authored Jun 19, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  60219995
- raise exception for pin_lora (#19809) · c7b370c6
  Ning Xie authored Jun 19, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c7b370c6
- [Misc] [ROCm] Prevent surplus tensor reshape (#19803) · aa20d10a
  zsolt-borbely-htec authored Jun 19, 2025
```
Signed-off-by: Zsolt Borbely <zsolt.borbely@htecgroup.com>
```
  aa20d10a
- [ROCm] [AITER] [Bugfix] Patch for AITER commit `648764942e552a8bb5fe16026703716a81f05374` (#18990) · 2de12be4
  TJian authored Jun 18, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  2de12be4
- Mark invariant normalizer in Gemma as non-persistent (#19788) · 83ca9ae4
  Yu-Hang "Maxin" Tang authored Jun 18, 2025
```
Signed-off-by: Yu-Hang Tang <Tang.Maxin@gmail.com>
```
  83ca9ae4
- [Bugfix] Add check_health to v1 async client. (#19821) · e2148dc5
  kourosh hakhamaneshi authored Jun 18, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  e2148dc5
- [Bugfix] Fix the linter (#19826) · b1098b40
  Lu Fang authored Jun 19, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  b1098b40
- Support embedding models in V1 (#16188) · 799397ee
  Maximilien de Bayser authored Jun 19, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  799397ee
- [Quantization] Modify the logic of BNB double quantization (#19742) · 49599150
  Jee Jee Li authored Jun 19, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  49599150
- [Misc][ROCm] Enforce no unused variable in ROCm C++ files (#19796) · 8d1e89d9
  Lu Fang authored Jun 19, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d1e89d9
- Fix FA2 fallback for Blackwell V1 (#19781) · 36239f79
  Michael Goin authored Jun 19, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  36239f79
- [Frontend] Expose custom args in OpenAI APIs (#16862) · dfada85e
  afeldman-nm authored Jun 18, 2025
```
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  dfada85e
- [BugFix] Fix use_cudagraph=False (#19612) · ed333497
  Richard Zou authored Jun 18, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  ed333497
18 Jun, 2025 20 commits
- [Multimodal] Use fast processor for Qwen2/2.5-VL (#19789) · d49adea1
  Woosuk Kwon authored Jun 18, 2025
  
  d49adea1
- [Core] More fixes to MultiModalEmbeddings type handling (#19715) · 14fdd21d
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  14fdd21d
- [TPU] Update torch-xla version to include paged attention tuned block change (#19813) · 04fefe7c
  QiliangCui authored Jun 18, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  04fefe7c
- [Core] Do not copy array during hashing (#19484) · 3b523e38
  Lukas Geiger authored Jun 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3b523e38
- Disable "Forbid direct 'import triton'" check for... · 16c16301
  afeldman-nm authored Jun 18, 2025
```
Disable "Forbid direct 'import triton'" check for `vllm/triton_utils/importing.py` in an extensible way (#19783)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  16c16301
- docs: fix Slack bulletpoint in README (#19811) · 9206d0ff
  Nathan Weinberg authored Jun 18, 2025
```
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
```
  9206d0ff
- [v1] Support mamba2 (#19327) · a89209b7
  Chen Zhang authored Jun 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  a89209b7
- [Docs] Add Huzaifa Sidhpurwala to vuln mgmt team doc (#19808) · ffacb222
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ffacb222
- [Bugfix] fix RAY_CGRAPH_get_timeout is not set successfully (#19725) · 12575cfa
  Chauncey authored Jun 19, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  12575cfa
- [Hardware][AMD] integrate aiter chunked prefill into vllm (#18596) · 8b6e1d63
  Zzz9990 authored Jun 18, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: fsx950223 <fsx950223@outlook.com>
Co-authored-by: charlifu <charlifu@amd.com>
```
  8b6e1d63
- [Qwen] Add tagging rule for Qwen related PRs (#19799) · 735a9de7
  Lu Fang authored Jun 18, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  735a9de7
- [Platform] Allow platform use V1 Engine by default (#19792) · 257ab954
  wangxiyuan authored Jun 18, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  257ab954
- [doc] fix the incorrect label (#19787) · cca91a7a
  Reid authored Jun 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  cca91a7a
- [Minor] Zero-initialize attn output buffer (#19784) · f04d6045
  Woosuk Kwon authored Jun 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f04d6045
- [V1] Decouple GPU and TPU `InputBatch` (#19778) · 19a53b27
  afeldman-nm authored Jun 18, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  19a53b27
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
- [V1] Add API docs for EncoderCacheManager (#19294) · 5f52a846
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  5f52a846
- [Misc] Add __str__ for RequestStatus (#19780) · d4629dc4
  lkchen authored Jun 17, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d4629dc4
- [MISC] correct DeviceConfig device field static type analysis (#19699) · 6e9cc73f
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6e9cc73f
- [MISC] correct copy_blocks src_to_dists param type (#19696) · c53711bd
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c53711bd
17 Jun, 2025 4 commits
- [TPU] Update torch version to include paged attention kernel change (#19706) · dac8cc49
  Chenyaaang authored Jun 17, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  dac8cc49
- [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) · a44b1c95
  Charlie Fu authored Jun 17, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  a44b1c95
- [Bugfix] Fix faulty triton importing logic when using Ray for DP (#19734) · b447624e
  Michael Goin authored Jun 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b447624e
- [Misc] Update lmcache connector with the latest connector apis (#19441) · cda92307
  Jiayi Yao authored Jun 17, 2025
```
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
```
  cda92307