Commits · 3cc3d9b950e4718de7af0cf4eb3e7b91ba16e8bb · change / sglang

22 Aug, 2025 1 commit
- Add Support for Page Size greater than 1 for Flashinfer MLA Backend (#8593) · 3cc3d9b9
  Pavani Majety authored Aug 21, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3cc3d9b9
09 Aug, 2025 1 commit
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
08 Jun, 2025 1 commit
- Fix CI and triton moe Configs (#6974) · 20d3ad3b
  Lianmin Zheng authored Jun 08, 2025
  
  20d3ad3b
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
01 May, 2025 1 commit
- Update ci test and doc for MTP api change (#5952) · ebaba856
  Ke Bao authored May 02, 2025
  
  ebaba856
05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
03 Apr, 2025 2 commits
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
30 Mar, 2025 1 commit
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
16 Mar, 2025 1 commit
- [Eagle] Remove the greedy branch and some redundant code (#4363) · 1b859295
  Ying Sheng authored Mar 16, 2025
```
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  1b859295
10 Mar, 2025 1 commit
- Minor style fix for sgl-kernel (#4243) · 730d084f
  Lianmin Zheng authored Mar 09, 2025
  
  730d084f
09 Mar, 2025 2 commits
- Fix test of flashinfer mla with nextn (#4237) · 9dfafa74
  Baizhou Zhang authored Mar 09, 2025
  
  9dfafa74
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
04 Mar, 2025 1 commit
- Update nextn ci test (#4071) · 03b0364f
  Ke Bao authored Mar 05, 2025
  
  03b0364f
01 Mar, 2025 1 commit

[Feature]Support ragged prefill in flashinfer mla backend (#3967) · 90a4b7d9

Baizhou Zhang authored Feb 28, 2025


Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>

90a4b7d9

17 Feb, 2025 3 commits
- chore: bump v0.4.3.post1 (#3638) · e782eb7e
  Yineng Zhang authored Feb 17, 2025
  
  e782eb7e
- update unit test (#3636) · e319153b
  Yineng Zhang authored Feb 17, 2025
  
  e319153b
- add mtp unit test (#3634) · 32b44d2f
  Yineng Zhang authored Feb 17, 2025
  
  32b44d2f
07 Feb, 2025 1 commit
- update unit test in AMD CI (#3366) · 2b1808ce
  Yineng Zhang authored Feb 07, 2025
  
  2b1808ce
01 Feb, 2025 1 commit
- Add test for fp8 torch compile (#3246) · 53179026
  Ke Bao authored Feb 01, 2025
  
  53179026
13 Jan, 2025 1 commit
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
18 Nov, 2024 1 commit
- Simplify flashinfer indices update for prefill (#2074) · 4af3f889
  Lianmin Zheng authored Nov 18, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: kavioyu <kavioyu@gmail.com>
```
  4af3f889
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
21 Sep, 2024 2 commits
- Add MLA gsm8k eval (#1484) · b8ccaf4d
  Ke Bao authored Sep 21, 2024
  
  b8ccaf4d
- Fix triton head num (#1482) · a68cb201
  Ke Bao authored Sep 21, 2024
  
  a68cb201
14 Sep, 2024 1 commit
- Add pytorch sampling backend ut (#1425) · 33b54e7c
  Ke Bao authored Sep 14, 2024
  
  33b54e7c
11 Sep, 2024 1 commit
- Deprecate --disable-flashinfer and introduce --attention-backend (#1380) · 46094e0c
  Lianmin Zheng authored Sep 10, 2024
  
  46094e0c
09 Sep, 2024 1 commit
- Add torchao quant (int4/int8/fp8) to llama models (#1341) · a7c47e0f
  Jerry Zhang authored Sep 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a7c47e0f
26 Aug, 2024 1 commit
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 3 commits
- Re-organize CI tests (#1052) · c877292c
  Lianmin Zheng authored Aug 12, 2024
  
  c877292c
- Add longer accuracy test on CI (#1049) · 41598e0d
  Lianmin Zheng authored Aug 12, 2024
  
  41598e0d
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
07 Aug, 2024 1 commit
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 1 commit
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c