Commits · 3a3918121f22c7a936df7cc248fa1a1b9507a0bc · change / sglang

"src/targets/gpu/vscode:/vscode.git/clone" did not exist on "b5ed08ce4f2adb9ce17fff9feee4468930751964"

06 Mar, 2025 1 commit
- Remove prefill-only-one-req (#4117) · 286e6540
  Lianmin Zheng authored Mar 05, 2025
  
  286e6540
04 Mar, 2025 1 commit
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

15 Feb, 2025 1 commit
- fix eagle unit test (#3591) · 6718b109
  Yineng Zhang authored Feb 15, 2025
  
  6718b109
26 Jan, 2025 1 commit
- Fix CI tests (#3132) · da6f8081
  Lianmin Zheng authored Jan 25, 2025
  
  da6f8081
21 Jan, 2025 1 commit
- Add accuracy and latency tests of eagle into CI (#3027) · a4331cd2
  Lianmin Zheng authored Jan 21, 2025
  
  a4331cd2
08 Dec, 2024 1 commit
- minor: update correct measurement unit (#2406) · 67470bbb
  Yineng Zhang authored Dec 08, 2024
  
  67470bbb
30 Nov, 2024 1 commit
- [CI] Print summary on github actions (#2274) · ccaf1f99
  Lianmin Zheng authored Nov 29, 2024
  
  ccaf1f99
25 Nov, 2024 1 commit
- Update CI threshold (#2186) · 3c5538f7
  Lianmin Zheng authored Nov 25, 2024
  
  3c5538f7
24 Nov, 2024 1 commit
- Update CI threshold & Improve code style (#2159) · 5652c565
  Lianmin Zheng authored Nov 24, 2024
  
  5652c565
20 Nov, 2024 1 commit
- Enable overlap by default (#2067) · 7d671e4a
  Lianmin Zheng authored Nov 19, 2024
  
  7d671e4a
18 Nov, 2024 1 commit
- feat: update torch 2.5.1 (#2069) · 76619261
  Yineng Zhang authored Nov 18, 2024
  
  76619261
17 Nov, 2024 3 commits
- Remove monkey_patch_vllm_dummy_weight_loader (#2064) · 38625e21
  Lianmin Zheng authored Nov 17, 2024
  
  38625e21
- Revert "chore: update torch v2.5.1" (#2063) · c1f401fc
  Lianmin Zheng authored Nov 17, 2024
  
  c1f401fc
- chore: update torch v2.5.1 (#1849) · 3b878863
  Yineng Zhang authored Nov 18, 2024
  
  3b878863
06 Oct, 2024 1 commit
- [Minor, Performance] Use torch.argmax for greedy sampling (#1589) · c98e84c2
  Ying Sheng authored Oct 06, 2024
  
  c98e84c2
04 Oct, 2024 1 commit
- [Fix] Fix major performance bug in certain cases (#1563) · 04b262cd
  Ying Sheng authored Oct 04, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  04b262cd
18 Sep, 2024 1 commit
- Fix oom issues with fp8 for llama (#1454) · 1acccb36
  Lianmin Zheng authored Sep 18, 2024
  
  1acccb36
14 Sep, 2024 1 commit
- Enable torch.compile for triton backend (#1422) · 9463bc13
  Lianmin Zheng authored Sep 14, 2024
  
  9463bc13
13 Sep, 2024 2 commits
- Balance test in CI (#1411) · ad0ff62a
  Lianmin Zheng authored Sep 12, 2024
  
  ad0ff62a
- [CI] Include triton backend and online serving benchmark into CI (#1408) · 68be2f6d
  Lianmin Zheng authored Sep 12, 2024
  
  68be2f6d