Commits · fcc2e37f695b2b5e50476f5e063d83f9f3f7878e · change / sglang

06 Mar, 2025 1 commit
- Split the __init__ of scheduler as smaller functions. Improve the eagle tests (#4128) · fcc2e37f
  Lianmin Zheng authored Mar 06, 2025
  
  fcc2e37f
04 Mar, 2025 1 commit
- Simplify eagle tests and TP sync in grammar backend (#4066) · 77a3954b
  Lianmin Zheng authored Mar 04, 2025
  
  77a3954b
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

20 Jan, 2025 1 commit
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
13 Jan, 2025 1 commit
- Collect more metrics: num_requests_total (#2859) · 51ab3ccf
  Lianmin Zheng authored Jan 13, 2025
  
  51ab3ccf
22 Dec, 2024 1 commit
- [Misc] Fix metrics, weight update lock, request logging (#2543) · 84967019
  Lianmin Zheng authored Dec 22, 2024
  
  84967019
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
10 Nov, 2024 1 commit
- Simplify prometheus metrics (#1981) · 1929c067
  Lianmin Zheng authored Nov 10, 2024
```
Co-authored-by: Mohit Reddy <mohitreddy1996@users.noreply.github.com>
```
  1929c067
09 Nov, 2024 2 commits
- Clean up metrics code (#1972) · 9c939a3d
  Lianmin Zheng authored Nov 09, 2024
  
  9c939a3d
- Fix metrics (#1963) · 95a4ed12
  Yudi Xue authored Nov 08, 2024
  
  95a4ed12