Commits · 6881107948c00a8564bc2fa85308f6fc2f065d64 · OpenDAS / vllm_cscc

"ssh:/git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "df5dafaa5ba611f7179720958ba63e49615c927f"

27 May, 2025 1 commit
- [V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) · 1f1b1bc0
  Isotr0py authored May 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1f1b1bc0
25 May, 2025 1 commit
- [Bugfix] Fix cpu usage and cache hit stats reporting on cpu environment (#18674) · f2faac74
  Yuqi Zhang authored May 25, 2025
```
Signed-off-by: zzzyq <zhangyuqi94@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  f2faac74
23 May, 2025 6 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Doc] Update references to doc files (#18637) · 7d921649
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7d921649
- [V1] Support Deepseek MTP (#18435) · 2628a69e
  Jiayi Yao authored May 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>
```
  2628a69e
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- [Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization... · c32e249a
  Sanger Steel authored May 22, 2025
```
[Frontend] [Core] Add Tensorizer support for V1, LoRA adapter serialization and deserialization (#17926)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
```
  c32e249a
21 May, 2025 2 commits
- [Misc] Update deprecation message for `--enable-reasoning` (#18404) · 2b161045
  Hyogeun Oh (오효근) authored May 21, 2025
  
  2b161045
- [Frontend] deprecate `--device` arg (#18399) · 5d7f5452
  Kebe authored May 21, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  5d7f5452
16 May, 2025 4 commits
- [Spec Decode] Don't fall back to V0 when spec decoding is enabled (#18265) · fabe89bb
  Woosuk Kwon authored May 16, 2025
  
  fabe89bb
- [Feature] Support Pipeline Parallism in torchrun SPMD offline inference for V1 (#17827) · 3d2779c2
  Lucia Fang authored May 15, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  3d2779c2
- Allow users to pass arbitrary JSON keys from CLI (#18208) · b18201fe
  Harry Mellor authored May 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b18201fe
- [Model] vLLM v1 supports Medusa (#17956) · f4937a51
  Sky Lee authored May 16, 2025
```
Signed-off-by: lisiqi23 <lisiqi23@xiaomi.com>
Signed-off-by: skylee-01 <497627264@qq.com>
Co-authored-by: lisiqi23 <lisiqi23@xiaomi.com>
```
  f4937a51
13 May, 2025 3 commits
- [V1] DP scale-out (2/N): Decouple engine process management and comms (#15977) · 55aa7af9
  Nick Hill authored May 13, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55aa7af9
- [Bugfix] Avoid repeatedly creating dummy data during engine startup (#17935) · 61e0a506
  Cyrus Leung authored May 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61e0a506
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
11 May, 2025 3 commits
- [Misc] not show --model in vllm serve --help (#16691) · 009b3d53
  Reid authored May 11, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  009b3d53
- [FP8][ROCm][Attention] Enable FP8 KV cache on ROCm for V1 (#17870) · 06c0922a
  Gregory Shtrasberg authored May 11, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  06c0922a
- [Perf] Use small max_num_batched_tokens for A100 (#17885) · 91121552
  Kuntai Du authored May 11, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  91121552
09 May, 2025 2 commits

Improve configs - the rest! (#17562) · 4b2ed792
Harry Mellor authored May 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4b2ed792

[FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6

vllmellm authored May 09, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>

3c9396a6

08 May, 2025 1 commit
- Improve exception reporting in MP engine (#17800) · b2da14a0
  Vadim Markovtsev authored May 08, 2025
```
Signed-off-by: Vadim Markovtsev <vadim@poolside.ai>
```
  b2da14a0
07 May, 2025 3 commits

Fix and simplify `deprecated=True` CLI `kwarg` (#17781) · 646a31e5
Harry Mellor authored May 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
646a31e5

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357) · 043e4c49

Satyajith Chilappagari authored May 07, 2025


Signed-off-by: Satyajith Chilappagari <satchill@amazon.com>
Co-authored-by: Aaron Dou <yzdou@amazon.com>
Co-authored-by: Shashwat Srijan <sssrijan@amazon.com>
Co-authored-by: Chongming Ni <chongmni@amazon.com>
Co-authored-by: Amulya Ballakur <amulyaab@amazon.com>
Co-authored-by: Patrick Lange <patlange@amazon.com>
Co-authored-by: Elaine Zhao <elaineyz@amazon.com>
Co-authored-by: Lin Lin Pan <tailinpa@amazon.com>
Co-authored-by: Navyadhara Gogineni <navyadha@amazon.com>
Co-authored-by: Yishan McNabb <yishanm@amazon.com>
Co-authored-by: Mrinal Shukla <181322398+mrinalks@users.noreply.github.com>

043e4c49

[Misc] Remove qlora_adapter_name_or_path (#17699) · ba7703e6
Jee Jee Li authored May 07, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
ba7703e6

06 May, 2025 4 commits
- [Bugfix] Fix for the condition to accept empty encoder inputs for mllama (#17732) · de906b95
  Gregory Shtrasberg authored May 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  de906b95
- [Feat] Add deprecated=True to CLI args (#17426) · 175bda67
  Aaron Pham authored May 06, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  175bda67
- [V1][PP] Support PP for MultiprocExecutor (#14219) · a6fed020
  Li, Jiang authored May 06, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  a6fed020
- [V1] Enable TPU V1 backend by default (#17673) · d419aa5d
  Michael Goin authored May 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d419aa5d
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
03 May, 2025 3 commits
- [Misc] V0 fallback for `--enable-prompt-embeds` (#17615) · 46fae69c
  Cyrus Leung authored May 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46fae69c
- [Core] Gate `prompt_embeds` behind a feature flag (#17607) · 887d7af8
  Cyrus Leung authored May 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  887d7af8
- [Frontend][TPU] Add TPU default max-num-batched-tokens based on device name (#17508) · 87baebeb
  Chenyaaang authored May 02, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  87baebeb
02 May, 2025 4 commits

[Misc] Clean up input processing (#17582) · cb234955
Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
cb234955
Automatically tell users that dict args must be valid JSON in CLI (#17577) · 785d75a0
Harry Mellor authored May 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
785d75a0

[Core] [Bugfix] Add Input Embeddings (#15428) · cc2a77d7

Andrew Sansom authored May 02, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

cc2a77d7

Add `pt_load_map_location` to allow loading to cuda (#16869) · 109e15a3
Jerry Zhang authored May 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
109e15a3

01 May, 2025 2 commits

[Misc]add configurable cuda graph size (#17201) · 61c299f8

Chen Xia authored May 01, 2025


Signed-off-by: CXIAAAAA <cxia0209@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

61c299f8

Move the last arguments in `arg_utils.py` to be in their final groups (#17531) · 6768ff4a
Harry Mellor authored May 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6768ff4a