Commits · 57d0bd91ec1775cd150629db14d39e07a876a45b · zhaoyu6 / sglang

18 Aug, 2024 1 commit
- Improve benchmark (#1140) · 57d0bd91
  Lianmin Zheng authored Aug 17, 2024
  
  57d0bd91
16 Aug, 2024 1 commit
- Fix port conflicts between local CI and runner CI. (#1131) · f624f6a6
  Liangsheng Yin authored Aug 16, 2024
  
  f624f6a6
13 Aug, 2024 1 commit
- ci: add moe test (#1053) · f7fb68d2
  Yineng Zhang authored Aug 13, 2024
  
  f7fb68d2
12 Aug, 2024 1 commit
- Improve end-to-end throughput test and its coverage (#1039) · 82076370
  Lianmin Zheng authored Aug 11, 2024
  
  82076370
11 Aug, 2024 1 commit
- Test the case when max_new_tokens is very large (#1038) · d84c5e70
  Lianmin Zheng authored Aug 11, 2024
  
  d84c5e70
08 Aug, 2024 2 commits
- Add e5-mistral embedding model - step 3/3 (#988) · e040a245
  Ying Sheng authored Aug 08, 2024
  
  e040a245
- feat: frequency, min_new_tokens, presence, and repetition penalties (#973) · ab787594
  Juwan Yoo authored Aug 08, 2024
  
  ab787594
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 3 commits
- Fix CI && python3.8 compatible (#920) · bb66cc4c
  Liangsheng Yin authored Aug 04, 2024
  
  bb66cc4c
- Make API Key OpenAI-compatible (#917) · 0d4f3a9f
  Ying Sheng authored Aug 04, 2024
  
  0d4f3a9f
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
02 Aug, 2024 1 commit
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
19 Jul, 2024 1 commit
- Update Readme (#660) · 51fda143
  Ying Sheng authored Jul 19, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  51fda143
04 Jun, 2024 1 commit
- [Minor] improve code style · 3bc01ac1
  Lianmin Zheng authored Jun 03, 2024
  
  3bc01ac1
27 May, 2024 1 commit
- Improve benchmark scripts & add more models (#484) · 09de730d
  Lianmin Zheng authored May 27, 2024
  
  09de730d
26 May, 2024 1 commit
- Improve benchmark scripts & rename some scripts (#477) · 55c16436
  Lianmin Zheng authored May 26, 2024
  
  55c16436
17 May, 2024 1 commit
- Improve error handling & abort disconnected requests (#449) · 8210ec60
  Lianmin Zheng authored May 17, 2024
  
  8210ec60
05 May, 2024 1 commit
- Organize Benchmark (#381) · 14522e6a
  Liangsheng Yin authored May 05, 2024
  
  14522e6a
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
22 Mar, 2024 1 commit
- Support oai in benchmark/mmlu (#323) · e2b2f0a2
  Lianmin Zheng authored Mar 22, 2024
  
  e2b2f0a2
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
16 Jan, 2024 1 commit
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
15 Jan, 2024 1 commit
- Json Decode && Mutl-Turns (#4) · 08ab2a16
  Liangsheng Yin authored Jan 15, 2024
  
  08ab2a16
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081