Commits · a17e70f5cc56c45e996d4ed8ea3118ecfa131e0f · change / sglang

29 Sep, 2025 1 commit
- Use more general heuristics to set the default value of --mem-fraction-static (#10975) · a17e70f5
  Lianmin Zheng authored Sep 29, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  a17e70f5
06 Sep, 2025 1 commit
- [7/N] MoE Refactor: the implementation of new framework (#9269) · 3fa62da7
  Cheng Wan authored Sep 05, 2025
  
  3fa62da7
09 Aug, 2025 1 commit
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
25 Jun, 2025 1 commit
- Fix FP8 KV Cache Support in FA3 Backend (#7148) · a1c1ebe9
  Yuhong Guo authored Jun 25, 2025
  
  a1c1ebe9
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
01 May, 2025 1 commit
- Update ci test and doc for MTP api change (#5952) · ebaba856
  Ke Bao authored May 02, 2025
  
  ebaba856
28 Apr, 2025 1 commit
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
28 Mar, 2025 1 commit
- Fix CI tests (#4853) · 47e6628a
  Lianmin Zheng authored Mar 28, 2025
  
  47e6628a
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
24 Mar, 2025 1 commit
- [ROCm] Enable MTP (NextN) on AMD GPU (#4631) · af6535e7
  Alex Sun authored Mar 24, 2025
  
  af6535e7
13 Mar, 2025 1 commit
- Support page size > 1 (#4356) · c76040e3
  Lianmin Zheng authored Mar 12, 2025
  
  c76040e3
08 Mar, 2025 2 commits
- Split test_mla.py into two files (#4216) · 48473684
  Lianmin Zheng authored Mar 08, 2025
  
  48473684
- [EAGLE] many fixes for eagle (#4195) · d4017a6b
  Lianmin Zheng authored Mar 07, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  d4017a6b
04 Mar, 2025 1 commit
- Update nextn ci test (#4071) · 03b0364f
  Ke Bao authored Mar 05, 2025
  
  03b0364f
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

17 Feb, 2025 3 commits
- chore: bump v0.4.3.post1 (#3638) · e782eb7e
  Yineng Zhang authored Feb 17, 2025
  
  e782eb7e
- update unit test (#3636) · e319153b
  Yineng Zhang authored Feb 17, 2025
  
  e319153b
- add mtp unit test (#3634) · 32b44d2f
  Yineng Zhang authored Feb 17, 2025
  
  32b44d2f
07 Feb, 2025 1 commit
- update unit test in AMD CI (#3366) · 2b1808ce
  Yineng Zhang authored Feb 07, 2025
  
  2b1808ce
01 Feb, 2025 1 commit
- Add test for fp8 torch compile (#3246) · 53179026
  Ke Bao authored Feb 01, 2025
  
  53179026
13 Jan, 2025 1 commit
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
18 Nov, 2024 1 commit
- Simplify flashinfer indices update for prefill (#2074) · 4af3f889
  Lianmin Zheng authored Nov 18, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: kavioyu <kavioyu@gmail.com>
```
  4af3f889
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
21 Sep, 2024 2 commits
- Add MLA gsm8k eval (#1484) · b8ccaf4d
  Ke Bao authored Sep 21, 2024
  
  b8ccaf4d
- Fix triton head num (#1482) · a68cb201
  Ke Bao authored Sep 21, 2024
  
  a68cb201
14 Sep, 2024 1 commit
- Add pytorch sampling backend ut (#1425) · 33b54e7c
  Ke Bao authored Sep 14, 2024
  
  33b54e7c
11 Sep, 2024 1 commit
- Deprecate --disable-flashinfer and introduce --attention-backend (#1380) · 46094e0c
  Lianmin Zheng authored Sep 10, 2024
  
  46094e0c
09 Sep, 2024 1 commit
- Add torchao quant (int4/int8/fp8) to llama models (#1341) · a7c47e0f
  Jerry Zhang authored Sep 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a7c47e0f
26 Aug, 2024 1 commit
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 3 commits
- Re-organize CI tests (#1052) · c877292c
  Lianmin Zheng authored Aug 12, 2024
  
  c877292c
- Add longer accuracy test on CI (#1049) · 41598e0d
  Lianmin Zheng authored Aug 12, 2024
  
  41598e0d
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
07 Aug, 2024 1 commit
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 2 commits
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a