Commits · 04fefe7c9a7947390885bac4f31f8c83a8aefd73 · OpenDAS / vllm_cscc · GitLab

18 Jun, 2025 18 commits
- [TPU] Update torch-xla version to include paged attention tuned block change (#19813) · 04fefe7c
  QiliangCui authored Jun 18, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  04fefe7c
- [Core] Do not copy array during hashing (#19484) · 3b523e38
  Lukas Geiger authored Jun 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3b523e38
- Disable "Forbid direct 'import triton'" check for... · 16c16301
  afeldman-nm authored Jun 18, 2025
```
Disable "Forbid direct 'import triton'" check for `vllm/triton_utils/importing.py` in an extensible way (#19783)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  16c16301
- docs: fix Slack bulletpoint in README (#19811) · 9206d0ff
  Nathan Weinberg authored Jun 18, 2025
```
Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
```
  9206d0ff
- [v1] Support mamba2 (#19327) · a89209b7
  Chen Zhang authored Jun 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  a89209b7
- [Docs] Add Huzaifa Sidhpurwala to vuln mgmt team doc (#19808) · ffacb222
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  ffacb222
- [Bugfix] fix RAY_CGRAPH_get_timeout is not set successfully (#19725) · 12575cfa
  Chauncey authored Jun 19, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  12575cfa
- [Hardware][AMD] integrate aiter chunked prefill into vllm (#18596) · 8b6e1d63
  Zzz9990 authored Jun 18, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: fsx950223 <fsx950223@outlook.com>
Co-authored-by: charlifu <charlifu@amd.com>
```
  8b6e1d63
- [Qwen] Add tagging rule for Qwen related PRs (#19799) · 735a9de7
  Lu Fang authored Jun 18, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  735a9de7
- [Platform] Allow platform use V1 Engine by default (#19792) · 257ab954
  wangxiyuan authored Jun 18, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  257ab954
- [doc] fix the incorrect label (#19787) · cca91a7a
  Reid authored Jun 18, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  cca91a7a
- [Minor] Zero-initialize attn output buffer (#19784) · f04d6045
  Woosuk Kwon authored Jun 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f04d6045
- [V1] Decouple GPU and TPU `InputBatch` (#19778) · 19a53b27
  afeldman-nm authored Jun 18, 2025
```
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  19a53b27
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
- [V1] Add API docs for EncoderCacheManager (#19294) · 5f52a846
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  5f52a846
- [Misc] Add __str__ for RequestStatus (#19780) · d4629dc4
  lkchen authored Jun 17, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d4629dc4
- [MISC] correct DeviceConfig device field static type analysis (#19699) · 6e9cc73f
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6e9cc73f
- [MISC] correct copy_blocks src_to_dists param type (#19696) · c53711bd
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c53711bd
17 Jun, 2025 21 commits
- [TPU] Update torch version to include paged attention kernel change (#19706) · dac8cc49
  Chenyaaang authored Jun 17, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  dac8cc49
- [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) · a44b1c95
  Charlie Fu authored Jun 17, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  a44b1c95
- [Bugfix] Fix faulty triton importing logic when using Ray for DP (#19734) · b447624e
  Michael Goin authored Jun 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b447624e
- [Misc] Update lmcache connector with the latest connector apis (#19441) · cda92307
  Jiayi Yao authored Jun 17, 2025
```
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
```
  cda92307
- Remove sm120 arch from sm100 cutlass kernel arch list (#19716) · bf57ccc5
  Michael Goin authored Jun 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bf57ccc5
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
- [Bugfix] Update multimodel models mapping to fit new checkpoint after Transformers v4.52 (#19151) · ca94d7fa
  Isotr0py authored Jun 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  ca94d7fa
- [Mis] remove duplicate engine status checks (#19647) · 5a1c2e15
  CYJiang authored Jun 17, 2025
```
Signed-off-by: googs1025 <googs1025@gmail.com>
```
  5a1c2e15
- [V1][Kernel] Flashinfer HND KV cache layout (#19280) · 4c8f64fa
  Nicolò Lucchesi authored Jun 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4c8f64fa
- [doc] split "Other AI Accelerators" tabs (#19708) · 93aee29f
  David Xia authored Jun 17, 2025
  
  93aee29f
- [doc][mkdocs] Add edit button to documentation (#19637) · 154d063b
  Reid authored Jun 17, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  154d063b
- [Kernel] Add Split-KV Support to Unified Triton Attention Kernel (#19152) · ccd7c050
  jvlunteren authored Jun 17, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  ccd7c050
- Add a doc on how to update PyTorch version (#19705) · c48c6c40
  Huy Do authored Jun 17, 2025
  
  c48c6c40
- [Doc] Add missing llava family multi-image examples (#19698) · aed84686
  Isotr0py authored Jun 17, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  aed84686
- [Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (#19686) · 5c76b9cd
  quanliu authored Jun 17, 2025
```
Signed-off-by: 刘全 <quan.liu2@dbappsecurity.com.cn>
Co-authored-by: 刘全 <quan.liu2@dbappsecurity.com.cn>
```
  5c76b9cd
- Fixes IMA for TP w/ flex-attention (#19712) · ddfed314
  Driss Guessous authored Jun 16, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  ddfed314
- [DOC] fix doc typos (#19600) · 5b3ad5ec
  Di Liu authored Jun 17, 2025
```
Signed-off-by: Di Liu <liu-di@sjtu.edu.cn>
```
  5b3ad5ec
- [Frontend] add chunking audio for > 30s audio (#19597) · ede5c4eb
  nguyenhoangthuan99 authored Jun 17, 2025
```
Signed-off-by: nguyenhoangthuan99 <thuanhppro12@gmail.com>
```
  ede5c4eb
- [Wheel Size] Only build FA2 8.0+PTX (#19336) · 07334959
  Lucas Wilkinson authored Jun 16, 2025
  
  07334959
- [doc] add project flag to gcloud TPU command (#19664) · 119f6839
  David Xia authored Jun 16, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  119f6839
- [Fix] Fall back to Gloo when NCCL backend is unavailable (#19641) · 0860087a
  Conroy Cheers authored Jun 17, 2025
```
Signed-off-by: conroy-cheers <conroy@corncheese.org>
```
  0860087a
16 Jun, 2025 1 commit
- [Quantization] Remove FP4 emulation; Fall-back to marlin for device < 100 (#19563) · 6bc7b573
  Dipika Sikka authored Jun 16, 2025
  
  6bc7b573