Commits · b1286a116aa2a58ad94c94989386ee36a6f5614f · change / sglang

16 Jun, 2025 1 commit
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7213) · b1286a11
  Lianmin Zheng authored Jun 16, 2025
  
  b1286a11
15 Jun, 2025 2 commits
- Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210) · fff10809
  Lianmin Zheng authored Jun 15, 2025
  
  fff10809
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7163) · 5f1ab327
  Lianmin Zheng authored Jun 14, 2025
  
  5f1ab327
14 Jun, 2025 2 commits
- Improve test cases for eagle infer (#7173) · ba589b88
  Lianmin Zheng authored Jun 13, 2025
  
  ba589b88
- Split the eagle test into two files (#7170) · 0fc3d992
  Lianmin Zheng authored Jun 13, 2025
  
  0fc3d992
09 Jun, 2025 1 commit
- Fix draft extend ut stability with flush cache (#6979) · cc74499d
  Ke Bao authored Jun 09, 2025
  
  cc74499d
08 Jun, 2025 1 commit
- Sync cuda graph runners (#6976) · 0c1f03a2
  Lianmin Zheng authored Jun 08, 2025
  
  0c1f03a2
02 Jun, 2025 1 commit
- Add draft extend CUDA graph for flashinfer backend (#6805) · a2cb5913
  Ke Bao authored Jun 02, 2025
  
  a2cb5913
27 May, 2025 1 commit
- Add batch test for draft extend (#6672) · f127355a
  Ke Bao authored May 28, 2025
  
  f127355a
22 May, 2025 1 commit
- Apply constraint grammar to EAGLE (#6499) · 6ce0ed07
  Ke Bao authored May 22, 2025
```
Co-authored-by: merrymercy <lianminzheng@gmail.com>
```
  6ce0ed07
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
27 Apr, 2025 1 commit
- Fix eagle test case (#5776) · 981a2619
  Lianmin Zheng authored Apr 27, 2025
  
  981a2619
25 Apr, 2025 1 commit
- Disable flaky eagle tests (#5753) · 21514ff5
  Lianmin Zheng authored Apr 25, 2025
  
  21514ff5
31 Mar, 2025 1 commit
- Fix oom error for large page size (#4913) · a169b9f8
  Zhiqiang Xie authored Mar 30, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a169b9f8
30 Mar, 2025 2 commits
- Fix 2-gpu CI test and suppress some warnings (#4930) · 9adf178c
  Lianmin Zheng authored Mar 30, 2025
  
  9adf178c
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
28 Mar, 2025 2 commits
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
- Fix CI tests (#4853) · 47e6628a
  Lianmin Zheng authored Mar 28, 2025
  
  47e6628a
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
18 Mar, 2025 1 commit
- [Feature] Support EAGLE 3 (#4247) · 9e0186f3
  James Liu authored Mar 18, 2025
  
  9e0186f3
16 Mar, 2025 1 commit
- [Eagle] Remove the greedy branch and some redundant code (#4363) · 1b859295
  Ying Sheng authored Mar 16, 2025
```
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  1b859295
08 Mar, 2025 2 commits
- lazy import attn backends (#4200) · 08c4d764
  Lianmin Zheng authored Mar 08, 2025
  
  08c4d764
- [EAGLE] many fixes for eagle (#4195) · d4017a6b
  Lianmin Zheng authored Mar 07, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  d4017a6b
06 Mar, 2025 2 commits
- Fix a draft model accuracy bug in eagle; support step=1; return logprob in eagle (#4134) · bc1534ff
  Lianmin Zheng authored Mar 06, 2025
```
Co-authored-by: Sehoon Kim <kssteven418@gmail.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  bc1534ff
- Split the __init__ of scheduler as smaller functions. Improve the eagle tests (#4128) · fcc2e37f
  Lianmin Zheng authored Mar 06, 2025
  
  fcc2e37f
05 Mar, 2025 1 commit
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
04 Mar, 2025 2 commits
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
- [Feature] Add test for speculative_token_map (#4016) · 0d4e3228
  William authored Mar 04, 2025
  
  0d4e3228
14 Feb, 2025 2 commits
- chore: bump v0.4.3 (#3556) · e0b9a423
  Yineng Zhang authored Feb 14, 2025
  
  e0b9a423
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
11 Feb, 2025 1 commit
- Support Eagle cuda graph for Triton backend (#3500) · 7e6d5fc6
  Ke Bao authored Feb 12, 2025
  
  7e6d5fc6
10 Feb, 2025 1 commit
- Support Eagle2 for Triton backend (#3466) · 2d611323
  Ke Bao authored Feb 10, 2025
  
  2d611323
09 Feb, 2025 3 commits
- minor: cleanup test_eagle_infer (#3415) · 60abdb3e
  Yineng Zhang authored Feb 09, 2025
  
  60abdb3e
- [Fix] Fix eagle with disable cuda graph (#3411) · 7b4e61ff
  Ying Sheng authored Feb 08, 2025
  
  7b4e61ff
- add disable cuda graph unit test for eagle 2 (#3412) · 6222e1c2
  Yineng Zhang authored Feb 09, 2025
  
  6222e1c2
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
10 Jan, 2025 1 commit
- [Eagle2] Fix multiple concurrent request crashes (#2730) · a47bf391
  justdoit authored Jan 11, 2025
  
  a47bf391
08 Jan, 2025 1 commit
- [eagle2] fix end check when target model verify (#2723) · 694e4192
  JJJJOHNSON authored Jan 08, 2025
  
  694e4192
02 Jan, 2025 1 commit

Eagle speculative decoding part 4: Add EAGLE2 worker (#2150) · 815dce05

yukavio authored Jan 02, 2025


Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

815dce05