Commits · c1e4a4052d65d72d45e39db1edb6b7deb4ffd426 · OpenDAS / vllm_cscc · GitLab

24 May, 2025 6 commits
- [V1][Spec Decode] Support multi-layer eagle draft model (#18030) · c1e4a405
  qizixi authored May 24, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  c1e4a405
- [Model] Add support for Qwen2.5-Omni-7B-AWQ (Qwen2_5OmniForConditionalGeneration) (#18647) · a8593205
  Yuanhao WU authored May 24, 2025
  
  a8593205
- [Frontend] improve vllm serve --help display (#18643) · 441dc63a
  Reid authored May 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  441dc63a
- [V1][Spec Decode] Small refactors to improve eagle bookkeeping performance (#18424) · d55e446d
  qizixi authored May 23, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  d55e446d
- FIX MOE issue in AutoRound format (#18586) · ec82c3e3
  Wenhua Cheng authored May 24, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  ec82c3e3
- config.py: Clarify that only local GGUF checkpoints are supported. (#18623) · 45ab403a
  Mathieu Borderé authored May 24, 2025
```
Signed-off-by: Mathieu Bordere <mathieu@letmetweakit.com>
```
  45ab403a
23 May, 2025 34 commits
- [Bugfix][Nixl] Fix Preemption Bug (#18631) · 2b10ba74
  Robert Shaw authored May 23, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  2b10ba74
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [ModelOpt] Introduce VLLM_MAX_TOKENS_PER_EXPERT_FP4_MOE env var to control... · f2036734
  Pavani Majety authored May 23, 2025
```
[ModelOpt] Introduce VLLM_MAX_TOKENS_PER_EXPERT_FP4_MOE env var to control blockscale tensor allocation (#18160)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  f2036734
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- [CI] Enable test_initialization to run on V1 (#16736) · 0ddf88e1
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0ddf88e1
- Use prebuilt FlashInfer x86_64 PyTorch 2.7 CUDA 12.8 wheel for CI (#18537) · 1645b601
  Huy Do authored May 23, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  1645b601
- [V1] Support Deepseek MTP (#18435) · 2628a69e
  Jiayi Yao authored May 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  2628a69e
- [Doc] Fix broken links and unlinked docs, add shortcuts to home sidebar (#18627) · 371f7e4c
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  371f7e4c
- [Doc] Avoid documenting dynamic / internal modules (#18626) · 15b45ffb
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  15b45ffb
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- [Doc] fix list formatting (#18624) · 8ddd1cf2
  David Xia authored May 23, 2025
```
Signed-off-by: David Xia <david@davidxia.com>
```
  8ddd1cf2
- [v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593) · 6550114c
  Chen Zhang authored May 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6550114c
- [Docs] Change mkdocs to not use directory urls (#18622) · 9520a989
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9520a989
- Fix figures in design doc (#18612) · 3d28ad34
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3d28ad34
- Refactor pplx init logic to make it modular (prepare for deepep) (#18200) · 6a7988c5
  youkaichao authored May 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6a7988c5
- [Doc] Use a different color for the announcement (#18616) · 022d8abe
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  022d8abe
- [Doc] Fix markdown list indentation for MkDocs rendering (#18620) · 5221815a
  Hyogeun Oh (오효근) authored May 24, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  5221815a
- [Bugfix][Build/CI] Fixup CUDA compiler version check for CUDA_SUPPORTED_ARCHS (#18579) · 1068556b
  Simon Mo authored May 23, 2025
  
  1068556b
- [Misc] add Haystack integration (#18601) · 2cd1fa45
  Reid authored May 23, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  2cd1fa45
- Include private attributes in API documentation (#18614) · d4c29197
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d4c29197
- [Bugfix] Fix transformers model impl ignored for mixtral quant (#18602) · 6220f3c6
  Tristan Leclercq authored May 23, 2025
```
Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>
```
  6220f3c6
- Fix examples with code blocks in docs (#18609) · 52fb23f4
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  52fb23f4
- [CI/Build] Fix V1 flag being set in entrypoints tests (#18598) · 6dd51c7e
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6dd51c7e
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a
- [Doc] Fix indent of contributing to vllm (#18611) · 38a95cb4
  Hyogeun Oh (오효근) authored May 23, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  38a95cb4
- [CI] fix kv_cache_type argument (#18594) · cd821ea5
  Ning Xie authored May 23, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  cd821ea5
- [Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to... · 7ab056c2
  Kay Yan authored May 23, 2025
```
[Hardware][CPU] Update intel_extension_for_pytorch 2.7.0 and move to `requirements/cpu.txt`  (#18542)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
```
  7ab056c2
- Add myself as docs code owner (#18605) · 6526e051
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6526e051
- [V0][Bugfix] Fix parallel sampling performance regression when guided decoding is enabled (#17731) · e493e485
  Madeesh Kannan authored May 23, 2025
```
Signed-off-by: Madeesh Kannan <shadeMe@users.noreply.github.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  e493e485
- [Bugfix][Model] Fix baichuan model loader for tp (#18597) · 4ce64e2d
  Mengqing Cao authored May 23, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  4ce64e2d
- Revert "[V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (#18034)" (#18600) · fbb13a2c
  Cyrus Leung authored May 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fbb13a2c
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- [Bugfix] Add half type support in reshape_and_cache_cpu_impl on x86 cpu platform (#18430) · d0bc2f81
  Yuqi Zhang authored May 23, 2025
```
Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
Co-authored-by: Yuqi Zhang <yuqizhang@google.com>
```
  d0bc2f81
- [Feature][V1]: suupports cached_tokens in response usage (#18149) · b046cf79
  Chauncey authored May 23, 2025
```
Co-authored-by: simon-mo <xmo@berkeley.edu>
```
  b046cf79