Commits · 6825d9a998df3f22b5e19fb600d0a0c09950db28 · OpenDAS / vllm_cscc · GitLab

25 May, 2025 1 commit
- [BugFix][Spec Decode] Improve Prefix Caching Logic in Speculative Decoding (#18668) · 6825d9a9
  Woosuk Kwon authored May 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6825d9a9
24 May, 2025 18 commits
- [CI/Build] fix permission denied issue (#18645) · b554ab73
  Reid authored May 25, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  b554ab73
- fix(regression): clone from reference items (#18662) · 9ea7f1ab
  Aaron Pham authored May 24, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  9ea7f1ab
- [CI] enforce import regex instead of re (#18665) · 2807271c
  Aaron Pham authored May 24, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  2807271c
- [BugFix] Fix import error for fused_moe (#18642) · b9018a3f
  wangxiyuan authored May 24, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  b9018a3f
- [MISC] typo fix and clean import (#18664) · 4ceafb62
  Ning Xie authored May 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  4ceafb62
- [CI/Build] `chmod +x` to `cleanup_pr_body.sh` (#18650) · 2e670578
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2e670578
- [Doc] Reorganize user guide (#18661) · 1cb194a0
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1cb194a0
- [Model] use AutoWeightsLoader for gpt2 (#18625) · 2cd4d58d
  ztang2370 authored May 24, 2025
```
Signed-off-by: zt2370 <ztang2370@gmail.com>
```
  2cd4d58d
- [Doc] Add community links (#18657) · 6d166a8d
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6d166a8d
- [Doc] Fix indentation problems in V0 Paged Attention docs (#18659) · ef1dd687
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef1dd687
- [MISC][pre-commit] Add pre-commit check for triton import (#17716) · e77dc4ba
  Mengqing Cao authored May 24, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  e77dc4ba
- [Doc] Update README links, mark external links (#18635) · 07458a51
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  07458a51
- [V1][Spec Decode] Support multi-layer eagle draft model (#18030) · c1e4a405
  qizixi authored May 24, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  c1e4a405
- [Model] Add support for Qwen2.5-Omni-7B-AWQ (Qwen2_5OmniForConditionalGeneration) (#18647) · a8593205
  Yuanhao WU authored May 24, 2025
  
  a8593205
- [Frontend] improve vllm serve --help display (#18643) · 441dc63a
  Reid authored May 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  441dc63a
- [V1][Spec Decode] Small refactors to improve eagle bookkeeping performance (#18424) · d55e446d
  qizixi authored May 23, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  d55e446d
- FIX MOE issue in AutoRound format (#18586) · ec82c3e3
  Wenhua Cheng authored May 24, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  ec82c3e3
- config.py: Clarify that only local GGUF checkpoints are supported. (#18623) · 45ab403a
  Mathieu Borderé authored May 24, 2025
```
Signed-off-by: Mathieu Bordere <mathieu@letmetweakit.com>
```
  45ab403a
23 May, 2025 21 commits
- [Bugfix][Nixl] Fix Preemption Bug (#18631) · 2b10ba74
  Robert Shaw authored May 23, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  2b10ba74
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [ModelOpt] Introduce VLLM_MAX_TOKENS_PER_EXPERT_FP4_MOE env var to control... · f2036734
  Pavani Majety authored May 23, 2025
```
[ModelOpt] Introduce VLLM_MAX_TOKENS_PER_EXPERT_FP4_MOE env var to control blockscale tensor allocation (#18160)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  f2036734
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- [CI] Enable test_initialization to run on V1 (#16736) · 0ddf88e1
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0ddf88e1
- Use prebuilt FlashInfer x86_64 PyTorch 2.7 CUDA 12.8 wheel for CI (#18537) · 1645b601
  Huy Do authored May 23, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  1645b601
- [V1] Support Deepseek MTP (#18435) · 2628a69e
  Jiayi Yao authored May 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  2628a69e
- [Doc] Fix broken links and unlinked docs, add shortcuts to home sidebar (#18627) · 371f7e4c
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  371f7e4c
- [Doc] Avoid documenting dynamic / internal modules (#18626) · 15b45ffb
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  15b45ffb
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- [Doc] fix list formatting (#18624) · 8ddd1cf2
  David Xia authored May 23, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  8ddd1cf2
- [v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593) · 6550114c
  Chen Zhang authored May 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6550114c
- [Docs] Change mkdocs to not use directory urls (#18622) · 9520a989
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9520a989
- Fix figures in design doc (#18612) · 3d28ad34
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3d28ad34
- Refactor pplx init logic to make it modular (prepare for deepep) (#18200) · 6a7988c5
  youkaichao authored May 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6a7988c5
- [Doc] Use a different color for the announcement (#18616) · 022d8abe
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  022d8abe
- [Doc] Fix markdown list indentation for MkDocs rendering (#18620) · 5221815a
  Hyogeun Oh (오효근) authored May 24, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  5221815a
- [Bugfix][Build/CI] Fixup CUDA compiler version check for CUDA_SUPPORTED_ARCHS (#18579) · 1068556b
  Simon Mo authored May 23, 2025
  
  1068556b
- [Misc] add Haystack integration (#18601) · 2cd1fa45
  Reid authored May 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2cd1fa45
- Include private attributes in API documentation (#18614) · d4c29197
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4c29197
- [Bugfix] Fix transformers model impl ignored for mixtral quant (#18602) · 6220f3c6
  Tristan Leclercq authored May 23, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  6220f3c6