Commits · 3a7cd627a86c61a6dbc8d365c2e3c921b94e9971 · OpenDAS / vllm_cscc

06 Jun, 2025 1 commit
- [Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033) · 3465b87e
  Benjamin Chislett authored Jun 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  3465b87e
05 Jun, 2025 1 commit
- [Bugfix] Fix port handling in make_zmq_path (#19117) · a408820f
  Michael Goin authored Jun 04, 2025
  
  a408820f
03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- Fix underscores in dict keys passed via CLI (#19030) · 476844d4
  Harry Mellor authored Jun 03, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  476844d4
01 Jun, 2025 1 commit
- [Core] Rework dtype resolution (#18751) · 6aa8f9a4
  Cyrus Leung authored Jun 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6aa8f9a4
30 May, 2025 2 commits
- [Perf] API-server scaleout with many-to-many server-engine comms (#17546) · 2dbe8c07
  Nick Hill authored May 30, 2025
  
  2dbe8c07
- [Misc]Fix typo (#18947) · 4577fc9a
  Always-Naive authored May 30, 2025
  
  4577fc9a
28 May, 2025 1 commit
- Enable Pydantic mypy checks and convert configs to Pydantic dataclasses (#17599) · 4c2b38ce
  Harry Mellor authored May 28, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4c2b38ce
27 May, 2025 2 commits

optimize get_kv_cache_torch_dtype (#18531) · 6b6d4961
chunxiaozheng authored May 27, 2025
```
Signed-off-by: idellzheng <idellzheng@tencent.com>
```
6b6d4961

[Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c

Hyogeun Oh (오효근) authored May 27, 2025


[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>

a68e293c

24 May, 2025 2 commits
- [Doc] Reorganize user guide (#18661) · 1cb194a0
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1cb194a0
- [Frontend] improve vllm serve --help display (#18643) · 441dc63a
  Reid authored May 24, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  441dc63a
23 May, 2025 4 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- [CI] Enable test_initialization to run on V1 (#16736) · 0ddf88e1
  Michael Goin authored May 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0ddf88e1
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
22 May, 2025 1 commit
- [Platform] Move platform check to right place (#18470) · 721fb9b1
  wangxiyuan authored May 23, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  721fb9b1
16 May, 2025 1 commit
- Allow users to pass arbitrary JSON keys from CLI (#18208) · b18201fe
  Harry Mellor authored May 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b18201fe
15 May, 2025 1 commit
- [V1] Update zmq socket creation in nixl connector (#18148) · a8f5aec2
  Russell Bryant authored May 15, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a8f5aec2
13 May, 2025 2 commits
- [V1] DP scale-out (2/N): Decouple engine process management and comms (#15977) · 55aa7af9
  Nick Hill authored May 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55aa7af9
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
09 May, 2025 1 commit
- Improve configs - the rest! (#17562) · 4b2ed792
  Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4b2ed792
07 May, 2025 1 commit
- Fix and simplify `deprecated=True` CLI `kwarg` (#17781) · 646a31e5
  Harry Mellor authored May 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  646a31e5
06 May, 2025 2 commits
- [TPU] Increase block size and reset block shapes (#16458) · 621ca2c0
  Jevin Jiang authored May 06, 2025
  
  621ca2c0
- [Feat] Add deprecated=True to CLI args (#17426) · 175bda67
  Aaron Pham authored May 06, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  175bda67
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
01 May, 2025 1 commit
- [Core] Enable IPv6 with vllm.utils.make_zmq_socket() (#16506) · fbefc8a7
  Russell Bryant authored May 01, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  fbefc8a7
26 Apr, 2025 1 commit
- Allocate kv_cache with stride order (#16605) · 9e96f56e
  Shu Wang authored Apr 26, 2025
```
Signed-off-by: shuw <shuw@nvidia.com>
```
  9e96f56e
25 Apr, 2025 1 commit
- [Bugfix][Misc] Use TritonPlaceholderModule to defensively import triton (#15099) · 2f540455
  Mengqing Cao authored Apr 25, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  2f540455
24 Apr, 2025 1 commit

[Bugfix] Enable V1 usage stats (#16986) · ed50f466

Michael Goin authored Apr 23, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

ed50f466

23 Apr, 2025 1 commit
- [Misc] Improve readability of get_open_port function. (#17024) · ec69124e
  huafeng authored Apr 23, 2025
```
Signed-off-by: gitover22 <qidizou88@gmail.com>
```
  ec69124e
16 Apr, 2025 1 commit
- [Misc] Modify LRUCache touch (#16689) · 0d7d05f4
  Jee Jee Li authored Apr 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0d7d05f4
14 Apr, 2025 1 commit
- [Bugfix] Multi-modal caches not acting like LRU caches (#16593) · aa29841e
  Cyrus Leung authored Apr 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa29841e
12 Apr, 2025 1 commit
- Fix syntaxWarning: invalid escape sequence '\s' (#16532) · 70363bcc
  Jie Fu (傅杰) authored Apr 12, 2025
```
Signed-off-by: Jie Fu <jiefu@tencent.com>
```
  70363bcc
11 Apr, 2025 1 commit
- Improve configs - `LoadConfig` (#16422) · cd77382a
  Harry Mellor authored Apr 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cd77382a
10 Apr, 2025 1 commit
- Fix the torch version parsing logic (#15857) · 7678fcd5
  Lu Fang authored Apr 10, 2025
  
  7678fcd5
09 Apr, 2025 1 commit

[Bug] [ROCm] Fix Llama 4 Enablement Bug on ROCm: V0 ROCmFlashAttentionImpl and... · 2976dc27

TJian authored Apr 09, 2025


[Bug] [ROCm] Fix Llama 4 Enablement Bug on ROCm: V0 ROCmFlashAttentionImpl and Triton Fused MoE bugs (#16198)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>

2976dc27

04 Apr, 2025 1 commit
- [V1] DP scale-out (1/N): Use zmq ROUTER/DEALER sockets for input queue (#15906) · 651cf0fe
  Nick Hill authored Apr 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  651cf0fe
01 Apr, 2025 1 commit
- [Feature] specify model in config.yaml (#15798) · 30d6a015
  Wei Zeng authored Apr 01, 2025
```
Signed-off-by: weizeng <weizeng@roblox.com>
```
  30d6a015
31 Mar, 2025 1 commit
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219