Commits · 8fb7b2fab9cec7866c0685513df29048ef60d41c · OpenDAS / vllm_cscc

26 Sep, 2025 1 commit
- [spec decode] Consolidate speculative decode method name for MTP (#25232) · c70ac4b8
  qizixi authored Sep 26, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  c70ac4b8
23 Sep, 2025 1 commit

[Spec Decode][CI] Add e2e test for `examples/spec_decode.py` and prevent... · 867ecdd1

Ekagra Ranjan authored Sep 23, 2025


[Spec Decode][CI] Add e2e test for `examples/spec_decode.py` and prevent breaking Acceptance Length (#24531)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

867ecdd1

18 Sep, 2025 1 commit
- [spec decode] Fix MTP inference path for MiMo-7B model (#25136) · c4cb0af9
  qizixi authored Sep 18, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c4cb0af9
28 Aug, 2025 1 commit
- [BugFix][Spec Decode] Use float64 for uniform_probs (#23803) · a3432f18
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  a3432f18
22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
31 Jul, 2025 1 commit
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
16 Jul, 2025 1 commit

[Meta] Llama4 EAGLE Support (#20591) · c11013db

zhiweiz authored Jul 15, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>

c11013db

04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
01 Jul, 2025 1 commit
- [Misc] Fix spec decode example (#20296) · 7151f922
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7151f922
30 Jun, 2025 1 commit
- [Spec Decode] Clean up spec decode example (#20240) · 2965c99c
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2965c99c
26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
12 Jun, 2025 1 commit
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
27 May, 2025 1 commit
- [V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010) · 06a03380
  Mark McLoughlin authored May 27, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  06a03380
26 May, 2025 1 commit
- Convert `examples` to `ruff-format` (#18400) · 27bebcd8
  Harry Mellor authored May 26, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  27bebcd8
14 May, 2025 1 commit

[V1][Spec Decode] Share input embedding of target model with EAGLE draft model... · 418d2f8b

Ekagra Ranjan authored May 14, 2025


[V1][Spec Decode] Share input embedding of target model with EAGLE draft model to free ~1GB for llama 3 model (#17326)
Co-authored-by: root <root@ekagra-8xh100.us-east5-a.c.serving-efficiency-poc.internal>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

418d2f8b

09 May, 2025 1 commit
- [V1][Spec Decoding] Include bonus tokens in mean acceptance length (#17908) · 7e357113
  Mark McLoughlin authored May 09, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  7e357113
29 Apr, 2025 1 commit
- [V1][Spec Decode] Apply torch.compile & cudagraph to EAGLE (#17211) · 70788bdb
  Bryan Lu authored Apr 29, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  70788bdb
25 Apr, 2025 1 commit

[V1][Spec Decode] EAGLE-3 Support (#16937) · a0e619e6

Benjamin Chislett authored Apr 25, 2025


Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Bryan Lu <yuzhelu@amazon.com>

a0e619e6

15 Apr, 2025 1 commit

[Misc] refactor argument parsing in examples (#16635) · 6ae996a8

Reid authored Apr 15, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

6ae996a8

10 Apr, 2025 1 commit
- [V1][Spec Decode] Eagle Model loading (#16035) · e8224f3d
  Lily Liu authored Apr 10, 2025
```
Signed-off-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
```
  e8224f3d
06 Apr, 2025 1 commit

[Misc] refactor example eagle (#16100) · b6c502a1

Reid authored Apr 06, 2025


Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

b6c502a1

31 Mar, 2025 1 commit
- [V1][Spec Decode] Remove deprecated spec decode config params (#15466) · 239b7bef
  shangmingc authored Apr 01, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  239b7bef
15 Mar, 2025 1 commit
- [Bugfix] EAGLE output norm bug (#14464) · 9ed6ee92
  Bryan Lu authored Mar 14, 2025
```
Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
```
  9ed6ee92