Commits · ac2387279ea98f28558e7a75972847b0ef9e8515 · change / sglang

03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

24 Jan, 2025 1 commit
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
08 Jan, 2025 1 commit
- Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784) · 8a690612
  Lianmin Zheng authored Jan 07, 2025
```
Co-authored-by: SangBin Cho rkooo567@gmail.com
```
  8a690612
17 Dec, 2024 1 commit
- Clean up GPU memory after killing sglang processes (#2457) · ce094a5d
  Ata Fatahi authored Dec 17, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  ce094a5d
08 Dec, 2024 1 commit
- Update killall_sglang.sh (#2397) · 96db0f66
  Lianmin Zheng authored Dec 08, 2024
  
  96db0f66
07 Dec, 2024 1 commit
- minor: update killall script (#2391) · 75ae9689
  Yineng Zhang authored Dec 08, 2024
  
  75ae9689
30 Nov, 2024 1 commit
- [CI] Kill zombie processes (#2280) · 0d6a49bd
  Lianmin Zheng authored Nov 30, 2024
  
  0d6a49bd
20 Nov, 2024 1 commit
- Enable overlap scheduler by default for the triton attention backend (#2105) · 722530fa
  Lianmin Zheng authored Nov 20, 2024
  
  722530fa
31 Oct, 2024 1 commit
- Fix memory leak for chunked prefill 2 (#1858) · a2e0424a
  Lianmin Zheng authored Oct 31, 2024
```
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  a2e0424a
30 Oct, 2024 1 commit
- Update docs (#1839) · b548801d
  Lianmin Zheng authored Oct 30, 2024
  
  b548801d
26 Oct, 2024 1 commit
- Update ci workflows (#1804) · 6aa94b96
  Lianmin Zheng authored Oct 26, 2024
  
  6aa94b96
21 Oct, 2024 1 commit
- Make token mapping non-blocking in the overlapped mode (#1740) · cf470fea
  Lianmin Zheng authored Oct 20, 2024
  
  cf470fea
04 Oct, 2024 1 commit
- Organize sampling batch info better (#1562) · 32eb6e96
  Lianmin Zheng authored Oct 03, 2024
  
  32eb6e96
10 Sep, 2024 1 commit
- [Minor] improve kill scripts and torchao import (#1375) · 6c7cb903
  Lianmin Zheng authored Sep 10, 2024
  
  6c7cb903
12 May, 2024 2 commits
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
- Clean up (#422) · 7023f413
  Lianmin Zheng authored May 11, 2024
  
  7023f413
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081