Commits · a50eb0e67687298d6a26508769ad4fd543687167 · change / sglang · GitLab

12 Nov, 2025 1 commit
- update to start mtp. · a55cb8b2
  linhai1 authored Nov 12, 2025
  
  a55cb8b2
19 Oct, 2025 1 commit
- make sure logit bias is applied during eagle spec decoding verification (#11555) · 1dacedd2
  Marin authored Oct 19, 2025
  
  1dacedd2
17 Oct, 2025 1 commit
- Abstraction for spec worker and code cleanup (#11643) · cde5a6e3
  Liangsheng Yin authored Oct 17, 2025
  
  cde5a6e3
13 Oct, 2025 3 commits
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441) · b6fb5d76
  Scott Lee authored Oct 13, 2025
  
  b6fb5d76
- Depreate `global_server_args_dict` (#11528) · 516738b0
  Liangsheng Yin authored Oct 13, 2025
  
  516738b0
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 2 commits
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
- Beta spec-overlap for EAGLE (#11398) · 20a6c0a6
  Liangsheng Yin authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  20a6c0a6
11 Oct, 2025 1 commit
- Separate allocation logic from scheduler (#11313) · b36afed4
  cctry authored Oct 10, 2025
  
  b36afed4
10 Oct, 2025 2 commits
- Revert "Add metrics for speculative decoding (acceptance rate, average acceptance length)" (#11433) · 55b14656
  Scott Lee authored Oct 10, 2025
  
  55b14656
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11144) · 0babd487
  Scott Lee authored Oct 10, 2025
  
  0babd487
02 Oct, 2025 2 commits
- Fix ngram spec with page size > 1 (#11135) · 25e7dbe8
  Liangsheng Yin authored Oct 02, 2025
  
  25e7dbe8
- Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720) · 0b2aa8a7
  Zhang Junda authored Oct 02, 2025
```
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
```
  0b2aa8a7
01 Oct, 2025 1 commit
- Organize spec-related data structures (#10735) · 73d4a5f8
  Liangsheng Yin authored Oct 01, 2025
  
  73d4a5f8
23 Sep, 2025 2 commits
- move `environ` into `sglang.srt` to avoid break SRT auto sync. (#10791) · 4a762041
  Liangsheng Yin authored Sep 23, 2025
  
  4a762041
- Use simulate acc len from `sglang.environ` (#10771) · 632b7d8c
  Liangsheng Yin authored Sep 23, 2025
  
  632b7d8c
14 Sep, 2025 1 commit
- fix duplicated logger in eager_utils (#10410) · 05b01ef4
  lijin23 authored Sep 14, 2025
  
  05b01ef4
22 Aug, 2025 1 commit
- [MTP] Force greedy sampling on AMD (#9127) · 110a6598
  datdo-msft authored Aug 22, 2025
  
  110a6598
20 Aug, 2025 1 commit
- Fixed the issue where eagle3 TPOT was not as good as without eagle3. (#9404) · e99729c9
  jiapingW authored Aug 21, 2025
  
  e99729c9
17 Aug, 2025 1 commit
- fix unexcepted answer in EAGLE mode (#9252) · 6a9d6ca3
  zyksir authored Aug 17, 2025
  
  6a9d6ca3
25 Jul, 2025 1 commit
- DP Enhancement (#8280) · c0fb25e9
  Cheng Wan authored Jul 24, 2025
  
  c0fb25e9
23 Jul, 2025 1 commit
- fix: prevent crashes due to logit bias dimension mismatch (#7685) · 0e7a5b26
  J authored Jul 23, 2025
  
  0e7a5b26
24 Jun, 2025 1 commit

Perormance: Enable cuda graph for dp idle batch (#7269) · ed0a0b69

u4lr451 authored Jun 24, 2025


Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>

ed0a0b69

23 Jun, 2025 1 commit
- Fix dtype for idle input in spec decoding (#7456) · f8d48fd3
  Cheng Wan authored Jun 23, 2025
  
  f8d48fd3
22 Jun, 2025 1 commit
- [minor] simplify the `TokenToKVPoolAllocator` (#7414) · 05c9bc89
  Liangsheng Yin authored Jun 22, 2025
  
  05c9bc89
17 Jun, 2025 2 commits

feat: mtp support dp-attention (#6081) · 10d60cd4

u4lr451 authored Jun 17, 2025


Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>

10d60cd4

Fix AMD speculative decoding (#7252) · 1a9c2c92
Lianmin Zheng authored Jun 16, 2025

1a9c2c92

16 Jun, 2025 2 commits
- [Eagle] Fix kernel call after updating speculative sampling kernels (#7231) · 53a525bf
  Lianmin Zheng authored Jun 16, 2025
  
  53a525bf
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7213) · b1286a11
  Lianmin Zheng authored Jun 16, 2025
  
  b1286a11
15 Jun, 2025 2 commits
- Revert "[EAGLE] Refactor code for page size > 1 & more simplifications" (#7210) · fff10809
  Lianmin Zheng authored Jun 15, 2025
  
  fff10809
- [EAGLE] Refactor code for page size > 1 & more simplifications (#7163) · 5f1ab327
  Lianmin Zheng authored Jun 14, 2025
  
  5f1ab327
10 Jun, 2025 1 commit
- Fix eagle on AMD (#7051) · 019851d0
  Lianmin Zheng authored Jun 10, 2025
  
  019851d0
09 Jun, 2025 1 commit
- Simplify prepare_extend_after_decode (#6987) · dc0705a5
  Lianmin Zheng authored Jun 09, 2025
  
  dc0705a5
08 Jun, 2025 1 commit
- Sync cuda graph runners (#6976) · 0c1f03a2
  Lianmin Zheng authored Jun 08, 2025
  
  0c1f03a2
07 Jun, 2025 1 commit
- Sync the changes on cuda graph runners (#6932) · 60fdad7c
  Lianmin Zheng authored Jun 06, 2025
  
  60fdad7c
27 May, 2025 1 commit
- Support EAGLE draft extend CUDA graph (#6606) · 63195028
  Ke Bao authored May 27, 2025
```
Co-authored-by: Sehoon Kim <sehoonkim@berkeley.edu>
```
  63195028
22 May, 2025 1 commit
- Apply constraint grammar to EAGLE (#6499) · 6ce0ed07
  Ke Bao authored May 22, 2025
```
Co-authored-by: merrymercy <lianminzheng@gmail.com>
```
  6ce0ed07
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
21 Apr, 2025 1 commit
- [misc] remove is_cuda_available (#5319) · 97cb762b
  JieXin Liang authored Apr 21, 2025
  
  97cb762b
09 Apr, 2025 1 commit
- Optimize topk operation in llama4 (#5128) · 86a876d8
  fzyzcjy authored Apr 09, 2025
  
  86a876d8