Commits · f6a1053ce59cd25552d5683225a104013c602afd · OpenDAS / vllm_cscc

18 Sep, 2025 1 commit
- [Model] Add LongCat-Flash · 50281e36
  zhuwenwen authored Sep 18, 2025
  
  50281e36
11 Sep, 2025 2 commits
- Update Spec Decode metrics to include drafted and accepted token throughput (#24127) · 79ac59f3
  Andrew Xia authored Sep 11, 2025
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  79ac59f3
- Add the support for the qwen3 next model (a hybrid attention model). (#24526) · e93f4cc9
  Tao He authored Sep 11, 2025
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  e93f4cc9
01 Sep, 2025 2 commits
- [bugfix]fix MTP hidden states (#24056) · a344a5aa
  Lucia Fang authored Sep 01, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  a344a5aa
- [Doc]: fix typos in Python comments (#24026) · 10728495
  Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  10728495
20 Aug, 2025 3 commits
- [FIXBUG ] Allow disabling rocm_aiter_fa backend for ROCm GPUs not compatible with AITER (#22795) · 3b11b26b
  JartX authored Aug 20, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  3b11b26b
- [Misc] Add max_seq_len to CommonAttentionMetadata (#23216) · d6d13bd4
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d6d13bd4
- [Model][V1] Support Ernie MTP (#22169) · 7cd17e22
  xyxinyang authored Aug 20, 2025
```
Signed-off-by: zhouchong <zhouchong03@baidu.com>
Co-authored-by: zhouchong <zhouchong03@baidu.com>
```
  7cd17e22
19 Aug, 2025 2 commits
- fix dense run error · 5b0a1c93
  zhuwenwen authored Aug 19, 2025
  
  5b0a1c93
- [Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c9b38be8
13 Aug, 2025 3 commits
- [Core] [N-gram SD Optimization][1/n] Propose tokens with a single KMP (#22437) · 31a500c8
  Jialin Ouyang authored Aug 13, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  31a500c8
- [V1] Add tree drafting tests for eagle spec decoding (#22705) · d94e3026
  Giancarlo Delfin authored Aug 13, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  d94e3026
- [feat]优化mtp/eagle的计算逻辑，减少第1层并行解码的计算重复（num_accepted_tokens_tensor修改暂未合入） · 4874e3e0
  zhuwenwen authored Aug 13, 2025
  
  4874e3e0
11 Aug, 2025 1 commit
- [fix]修复v1 mtp接受率低的问题 · db554c6c
  zhuwenwen authored Aug 11, 2025
```
更改默认的full _cuda_graph启动方式为false
```
  db554c6c
08 Aug, 2025 1 commit
- [ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine (#21496) · 1ee5ead5
  TJian authored Aug 07, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  1ee5ead5
07 Aug, 2025 3 commits
- [feat]支持mtp模型full_cuda_graph · ffe9e7db
  zhuwenwen authored Aug 07, 2025
  
  ffe9e7db
- [feat]支持mtp模型full_cuda_graph · f2218895
  zhuwenwen authored Aug 07, 2025
  
  f2218895
- [Attention] Support multiple attention metadata builders per kv_cache_spec +... · 1dc8a70b
  Lucas Wilkinson authored Aug 06, 2025
```
[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1dc8a70b
06 Aug, 2025 4 commits
- Revert "Revert "[feat]优化mtp相关函数返回类型"" · c17574bd
  zhuwenwen authored Aug 06, 2025
```
This reverts commit c34fa0bf.
```
  c17574bd
- Revert "Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样"" · 467490e6
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 33485749.
```
  467490e6
- Revert "[feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样" · 33485749
  zhuwenwen authored Aug 06, 2025
```
This reverts commit 93fae6b1.
```
  33485749
- Revert "[feat]优化mtp相关函数返回类型" · c34fa0bf
  zhuwenwen authored Aug 06, 2025
```
This reverts commit edc45625.
```
  c34fa0bf
05 Aug, 2025 2 commits
- [feat]优化mtp相关函数返回类型 · edc45625
  zhuwenwen authored Aug 05, 2025
  
  edc45625
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 93fae6b1
  zhuwenwen authored Aug 05, 2025
  
  93fae6b1
04 Aug, 2025 1 commit
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
31 Jul, 2025 1 commit
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
26 Jul, 2025 1 commit

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

17 Jul, 2025 1 commit
- [Attention] Refactor attention metadata builder interface (#20466) · 76b49444
  Lucas Wilkinson authored Jul 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  76b49444
12 Jul, 2025 1 commit
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
07 Jul, 2025 1 commit
- [feat]支持v1 engine flashmla和mtp同时开启 · ac4dedb1
  王敏 authored Jul 07, 2025
  
  ac4dedb1
06 Jul, 2025 1 commit
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
02 Jul, 2025 1 commit

[V1] LogitsProcessor programming model (#16728) · 48fb076c

afeldman-nm authored Jul 02, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

48fb076c

30 Jun, 2025 1 commit
- [fix]解决v1 engine mtp只能设为1的问题 · 504c262e
  王敏 authored Jun 30, 2025
  
  504c262e
25 Jun, 2025 1 commit
- [V1][Speculative Decoding] Fix DeepSeek MTP (#20022) · 8359f4c8
  cjackal authored Jun 26, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  8359f4c8
13 Jun, 2025 3 commits
- [CUDA] Enable full cudagraph for FlashMLA (#18581) · 3597b06a
  Luka Govedič authored Jun 13, 2025
```
Signed-off-by: luka <luka@neuralmagic.com>
```
  3597b06a
- [torch.compile] reorganize the cache directory to support compiling multiple models (#19064) · d70bc7c0
  youkaichao authored Jun 13, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  d70bc7c0
- [Bugfix] Fix EAGLE vocab embedding for multimodal target model (#19570) · c68698b3
  qizixi authored Jun 12, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
```
  c68698b3
06 Jun, 2025 1 commit
- [Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033) · 3465b87e
  Benjamin Chislett authored Jun 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  3465b87e
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
28 May, 2025 1 commit
- [V1] [Bugfix] eagle bugfix and enable correct lm_head for multimodal (2) (#18781) · 5e13c07d
  RonaldBXu authored May 27, 2025
```
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>
```
  5e13c07d