Commits · 2d72fc47cf585dcf5aee987d030c646b6527b5e1 · change / sglang

31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
24 May, 2025 1 commit
- Fix GPU OOM (#6564) · 7a5e6ce1
  kk authored May 25, 2025
```
Co-authored-by: michael <michael.zhang@amd.com>
```
  7a5e6ce1
14 May, 2025 1 commit
- Enable unit tests for AMD CI. (#6283) · 73eb67c0
  Sai Enduri authored May 14, 2025
  
  73eb67c0
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
01 May, 2025 1 commit
- Update ci test and doc for MTP api change (#5952) · ebaba856
  Ke Bao authored May 02, 2025
  
  ebaba856
29 Apr, 2025 1 commit
- [CI] tune the test order to warmup the server (#5860) · 26fc32d1
  Lianmin Zheng authored Apr 28, 2025
  
  26fc32d1
28 Apr, 2025 1 commit
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
27 Apr, 2025 2 commits
- [CI] Improve github summary & enable fa3 for more models (#5796) · daed453e
  Lianmin Zheng authored Apr 27, 2025
  
  daed453e
- Add 8-GPU Test for Deepseek-V3 (#5691) · f9fb33ef
  Baizhou Zhang authored Apr 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  f9fb33ef
28 Mar, 2025 1 commit
- Fix CI tests (#4853) · 47e6628a
  Lianmin Zheng authored Mar 28, 2025
  
  47e6628a
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
24 Mar, 2025 1 commit
- [ROCm] Enable MTP (NextN) on AMD GPU (#4631) · af6535e7
  Alex Sun authored Mar 24, 2025
  
  af6535e7
13 Mar, 2025 1 commit
- Support page size > 1 (#4356) · c76040e3
  Lianmin Zheng authored Mar 12, 2025
  
  c76040e3
08 Mar, 2025 2 commits
- Split test_mla.py into two files (#4216) · 48473684
  Lianmin Zheng authored Mar 08, 2025
  
  48473684
- [EAGLE] many fixes for eagle (#4195) · d4017a6b
  Lianmin Zheng authored Mar 07, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  d4017a6b
04 Mar, 2025 1 commit
- Update nextn ci test (#4071) · 03b0364f
  Ke Bao authored Mar 05, 2025
  
  03b0364f
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

17 Feb, 2025 3 commits
- chore: bump v0.4.3.post1 (#3638) · e782eb7e
  Yineng Zhang authored Feb 17, 2025
  
  e782eb7e
- update unit test (#3636) · e319153b
  Yineng Zhang authored Feb 17, 2025
  
  e319153b
- add mtp unit test (#3634) · 32b44d2f
  Yineng Zhang authored Feb 17, 2025
  
  32b44d2f
07 Feb, 2025 1 commit
- update unit test in AMD CI (#3366) · 2b1808ce
  Yineng Zhang authored Feb 07, 2025
  
  2b1808ce
01 Feb, 2025 1 commit
- Add test for fp8 torch compile (#3246) · 53179026
  Ke Bao authored Feb 01, 2025
  
  53179026
13 Jan, 2025 1 commit
- Use only one GPU for MLA CI tests (#2858) · 67008f4b
  Lianmin Zheng authored Jan 13, 2025
  
  67008f4b
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
18 Nov, 2024 1 commit
- Simplify flashinfer indices update for prefill (#2074) · 4af3f889
  Lianmin Zheng authored Nov 18, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: kavioyu <kavioyu@gmail.com>
```
  4af3f889
27 Oct, 2024 1 commit
- Add a watch dog thread (#1816) · 86fc0d79
  Lianmin Zheng authored Oct 27, 2024
  
  86fc0d79
21 Sep, 2024 2 commits
- Add MLA gsm8k eval (#1484) · b8ccaf4d
  Ke Bao authored Sep 21, 2024
  
  b8ccaf4d
- Fix triton head num (#1482) · a68cb201
  Ke Bao authored Sep 21, 2024
  
  a68cb201
14 Sep, 2024 1 commit
- Add pytorch sampling backend ut (#1425) · 33b54e7c
  Ke Bao authored Sep 14, 2024
  
  33b54e7c
11 Sep, 2024 1 commit
- Deprecate --disable-flashinfer and introduce --attention-backend (#1380) · 46094e0c
  Lianmin Zheng authored Sep 10, 2024
  
  46094e0c
09 Sep, 2024 1 commit
- Add torchao quant (int4/int8/fp8) to llama models (#1341) · a7c47e0f
  Jerry Zhang authored Sep 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a7c47e0f
26 Aug, 2024 1 commit
- improve the threshold and ports in tests (#1215) · 158e8f1e
  Mingyi authored Aug 25, 2024
  
  158e8f1e
13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 3 commits
- Re-organize CI tests (#1052) · c877292c
  Lianmin Zheng authored Aug 12, 2024
  
  c877292c
- Add longer accuracy test on CI (#1049) · 41598e0d
  Lianmin Zheng authored Aug 12, 2024
  
  41598e0d
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
07 Aug, 2024 1 commit
- chore: update vllm to 0.5.4 (#966) · c31f084c
  Yineng Zhang authored Aug 07, 2024
  
  c31f084c
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 1 commit
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c