Commits · 584e1ab2d06360b3c34a9edbde1679d4bae46c34 · zhaoyu6 / sglang

"vscode:/vscode.git/clone" did not exist on "b5dd5e87416acc05576e286b826b62e97264a0fb"

15 Aug, 2025 1 commit
- fix: fix unsupported palette mode of images in bench_serving for mmmu (#9206) · 584e1ab2
  Mick authored Aug 15, 2025
  
  584e1ab2
08 Jul, 2025 1 commit
- [Multimodal][Perf] Use `pybase64` instead of `base64` (#7724) · a37e1247
  Brayden Zhong authored Jul 08, 2025
  
  a37e1247
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
28 Jun, 2025 1 commit

oai: Adds support for OpenAI chat completions API in bench_serving (#7036) · c45e49d8

Xinyuan Tong authored Jun 28, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>

c45e49d8

11 Jun, 2025 1 commit
- Support VILA models (#6106) · 31d6dee5
  Zijian authored Jun 12, 2025
  
  31d6dee5
07 Jun, 2025 1 commit
- [Refactor] image data process in bench_serving (#6879) · 697b0f71
  Xinyuan Tong authored Jun 06, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  697b0f71
31 May, 2025 1 commit
- [FIX] mmmu bench serving result display error (#6525) (#6791) · fb507b7b
  Yikai Zhang authored Jun 01, 2025
  
  fb507b7b
30 May, 2025 1 commit
- Fix aiohttp 'Chunk too big' in bench_serving (#6737) · d279d499
  Yuhong Guo authored May 30, 2025
  
  d279d499
26 May, 2025 4 commits
- Tiny fix CI (#6611) · 501efc3d
  fzyzcjy authored May 26, 2025
  
  501efc3d
- Support accurate length control for bench serving (#6594) · 6bebef60
  fzyzcjy authored May 26, 2025
  
  6bebef60
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
- Fix bench_serving does not support changing warmup requests (#6439) · 2c3a6fe1
  fzyzcjy authored May 26, 2025
  
  2c3a6fe1
22 May, 2025 2 commits
- misc: fix accept_length (#6536) · a6970a17
  Yineng Zhang authored May 22, 2025
  
  a6970a17
- Recover from corrupted cache file in bench serving (#6510) · 969660c7
  fzyzcjy authored May 22, 2025
  
  969660c7
21 May, 2025 1 commit
- Let bench_one_batch_server use sharegpt data to make expert distribution more natural (#5573) · 7222e1da
  fzyzcjy authored May 21, 2025
  
  7222e1da
18 May, 2025 3 commits
- Tiny refactor bench_serving to extract RequestFuncOutput.init_new (#6108) · 26ebb849
  fzyzcjy authored May 18, 2025
  
  26ebb849
- Tiny refactor bench_serving to improve extensibility (#6134) · 02973cd9
  fzyzcjy authored May 18, 2025
  
  02973cd9
- Support outputing details for bench_serving (#6107) · 6d95a35a
  fzyzcjy authored May 18, 2025
  
  6d95a35a
12 May, 2025 2 commits
- fix typo (#6248) · f24fc5b8
  Yineng Zhang authored May 12, 2025
  
  f24fc5b8
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
08 May, 2025 1 commit
- [CI]Add performance CI for VLM (#6038) · e88dd482
  XinyuanTong authored May 07, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  e88dd482
27 Apr, 2025 2 commits
- [CI] fix port conflicts (#5789) · 35ca04d2
  Lianmin Zheng authored Apr 27, 2025
  
  35ca04d2
- fix: Use `is not None` instead of `!= None` for None checks. (#5687) · 094891c0
  vzed authored Apr 26, 2025
  
  094891c0
23 Apr, 2025 1 commit
- fix: update truss bench_serving (#5683) · b1f6d89b
  Yineng Zhang authored Apr 23, 2025
  
  b1f6d89b
22 Apr, 2025 1 commit
- fix: update bench_speculative (#5649) · 7282ab74
  Yineng Zhang authored Apr 22, 2025
  
  7282ab74
20 Apr, 2025 1 commit
- Fix bench_serving fail when zero warmup requests (#5574) · 9924bbe1
  fzyzcjy authored Apr 21, 2025
  
  9924bbe1
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
15 Apr, 2025 1 commit
- Fix bench_serving with random-ids (#5214) · 3dfc6023
  Yuhong Guo authored Apr 15, 2025
  
  3dfc6023
04 Apr, 2025 1 commit
- Add DeepSeek V3/R1 shared experts fusion (#4918) · 924ca7c9
  Xiaoyu Zhang authored Apr 04, 2025
  
  924ca7c9
01 Apr, 2025 1 commit
- update bench_serving (#4958) · fda6bb78
  Yineng Zhang authored Apr 01, 2025
  
  fda6bb78
28 Mar, 2025 1 commit
- [Feature] add multi-rank support for Lora (#4492) · ef9a378a
  chaobo jia authored Mar 29, 2025
```
Co-authored-by: rudy152 <czh1137892874@gmail.com>
```
  ef9a378a
24 Mar, 2025 1 commit
- Support FA3 as Attention backend by using `--attention-backend fa3` (#4680) · 5d7edc8e
  Stefan He authored Mar 23, 2025
```
Co-authored-by: qsong <qsong@linkedin.com>
Co-authored-by: qingquansong <ustcsqq@gmail.com>
```
  5d7edc8e
15 Mar, 2025 1 commit
- Update bench_serving.py (#4454) · 470b4740
  Xu Song authored Mar 16, 2025
  
  470b4740
08 Mar, 2025 1 commit
- Fix bench_serving flush cache not recognizing OPENAI_API_KEY (#4181) · 0fe7c13b
  Mingshan authored Mar 08, 2025
```
Signed-off-by: Mingshan <git@brighill.com>
```
  0fe7c13b
06 Mar, 2025 1 commit
- fix bench serving bug (#4135) · 3a391812
  Lzhang-hub authored Mar 06, 2025
  
  3a391812
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
03 Mar, 2025 2 commits

Improve code styles (#4021) · 66301e12
Lianmin Zheng authored Mar 03, 2025

66301e12

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

28 Feb, 2025 1 commit
- Fix bench_serving not recognizing OPENAI_API_KEY (#3870) · ec0a72c2
  Kebe authored Feb 28, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  ec0a72c2