Commits · 5ca07eed90185816336d852b7652ff1b828b9896 · change / sglang

10 Jun, 2025 1 commit
- Fix eagle on AMD (#7051) · 019851d0
  Lianmin Zheng authored Jun 10, 2025
  
  019851d0
09 Jun, 2025 1 commit

chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2

Yineng Zhang authored Jun 09, 2025


Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>

56ccd3c2

31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
24 May, 2025 1 commit
- Fix GPU OOM (#6564) · 7a5e6ce1
  kk authored May 25, 2025
```
Co-authored-by: michael <michael.zhang@amd.com>
```
  7a5e6ce1
12 May, 2025 1 commit
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
11 May, 2025 1 commit
- Fix request abortion (#6184) · de167cf5
  Lianmin Zheng authored May 10, 2025
  
  de167cf5
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
08 May, 2025 2 commits
- Change AMD test threshold (#6091) · a05bd83a
  fzyzcjy authored May 08, 2025
  
  a05bd83a
- [CI]Add performance CI for VLM (#6038) · e88dd482
  XinyuanTong authored May 07, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  e88dd482
02 May, 2025 1 commit
- Add 1 gpu perf and 2 gpu accuracy tests for AMD MI300x CI. (#5960) · 73bc1d00
  Sai Enduri authored May 01, 2025
  
  73bc1d00
30 Apr, 2025 1 commit
- Add TP2 MOE benchmarks for AMD. (#5909) · 2afba1b1
  Sai Enduri authored Apr 30, 2025
  
  2afba1b1
27 Apr, 2025 3 commits
- [CI] Improve github summary & enable fa3 for more models (#5796) · daed453e
  Lianmin Zheng authored Apr 27, 2025
  
  daed453e
- [CI] Fix test case (#5790) · a38f6932
  Lianmin Zheng authored Apr 27, 2025
  
  a38f6932
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
25 Mar, 2025 1 commit
- Add retry for flaky tests in CI (#4755) · 15ddd843
  fzyzcjy authored Mar 26, 2025
  
  15ddd843
06 Mar, 2025 2 commits
- Fix a draft model accuracy bug in eagle; support step=1; return logprob in eagle (#4134) · bc1534ff
  Lianmin Zheng authored Mar 06, 2025
```
Co-authored-by: Sehoon Kim <kssteven418@gmail.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  bc1534ff
- Remove prefill-only-one-req (#4117) · 286e6540
  Lianmin Zheng authored Mar 05, 2025
  
  286e6540
04 Mar, 2025 1 commit
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

15 Feb, 2025 1 commit
- fix eagle unit test (#3591) · 6718b109
  Yineng Zhang authored Feb 15, 2025
  
  6718b109
26 Jan, 2025 1 commit
- Fix CI tests (#3132) · da6f8081
  Lianmin Zheng authored Jan 25, 2025
  
  da6f8081
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
08 Dec, 2024 1 commit
- minor: update correct measurement unit (#2406) · 67470bbb
  Yineng Zhang authored Dec 08, 2024
  
  67470bbb
30 Nov, 2024 1 commit
- [CI] Print summary on github actions (#2274) · ccaf1f99
  Lianmin Zheng authored Nov 29, 2024
  
  ccaf1f99
25 Nov, 2024 1 commit
- Update CI threshold (#2186) · 3c5538f7
  Lianmin Zheng authored Nov 25, 2024
  
  3c5538f7
24 Nov, 2024 1 commit
- Update CI threshold & Improve code style (#2159) · 5652c565
  Lianmin Zheng authored Nov 24, 2024
  
  5652c565
20 Nov, 2024 1 commit
- Enable overlap by default (#2067) · 7d671e4a
  Lianmin Zheng authored Nov 19, 2024
  
  7d671e4a
18 Nov, 2024 1 commit
- feat: update torch 2.5.1 (#2069) · 76619261
  Yineng Zhang authored Nov 18, 2024
  
  76619261
17 Nov, 2024 3 commits
- Remove monkey_patch_vllm_dummy_weight_loader (#2064) · 38625e21
  Lianmin Zheng authored Nov 17, 2024
  
  38625e21
- Revert "chore: update torch v2.5.1" (#2063) · c1f401fc
  Lianmin Zheng authored Nov 17, 2024
  
  c1f401fc
- chore: update torch v2.5.1 (#1849) · 3b878863
  Yineng Zhang authored Nov 18, 2024
  
  3b878863
06 Oct, 2024 1 commit
- [Minor, Performance] Use torch.argmax for greedy sampling (#1589) · c98e84c2
  Ying Sheng authored Oct 06, 2024
  
  c98e84c2
04 Oct, 2024 1 commit
- [Fix] Fix major performance bug in certain cases (#1563) · 04b262cd
  Ying Sheng authored Oct 04, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  04b262cd
18 Sep, 2024 1 commit
- Fix oom issues with fp8 for llama (#1454) · 1acccb36
  Lianmin Zheng authored Sep 18, 2024
  
  1acccb36
14 Sep, 2024 1 commit
- Enable torch.compile for triton backend (#1422) · 9463bc13
  Lianmin Zheng authored Sep 14, 2024
  
  9463bc13
13 Sep, 2024 2 commits
- Balance test in CI (#1411) · ad0ff62a
  Lianmin Zheng authored Sep 12, 2024
  
  ad0ff62a
- [CI] Include triton backend and online serving benchmark into CI (#1408) · 68be2f6d
  Lianmin Zheng authored Sep 12, 2024
  
  68be2f6d