Commits · 28b4d8e14472eda2f4e779c2e3a7f9eac5a522b3 · change / sglang

24 Sep, 2024 1 commit
- Update test_srt_backend.py (#1502) · 28b4d8e1
  Lianmin Zheng authored Sep 24, 2024
  
  28b4d8e1
03 Sep, 2024 1 commit
- [Fix] Fix select by ensuring each request has at least one token (#1318) · 1e495e08
  Lianmin Zheng authored Sep 03, 2024
  
  1e495e08
14 Aug, 2024 1 commit
- Use `dtype` to control generate (#1082) · a34dd86a
  Liangsheng Yin authored Aug 14, 2024
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  a34dd86a
10 Aug, 2024 1 commit
- Clean up unit tests (#1020) · 54fb1c80
  Lianmin Zheng authored Aug 10, 2024
  
  54fb1c80
05 Aug, 2024 2 commits
- Feat: add alternative choices selection methods (#835) · 94e01151
  Aidan Cooper authored Aug 05, 2024
  
  94e01151
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 1 commit
- Improve the structure of CI (#911) · 995af5a5
  Ying Sheng authored Aug 03, 2024
  
  995af5a5
02 Aug, 2024 2 commits
- fix: set env in runner (#891) · 2e218b9e
  Yineng Zhang authored Aug 02, 2024
  
  2e218b9e
- Add accuracy test to CI: MMLU (#882) · ae7ee01a
  Ying Sheng authored Aug 01, 2024
  
  ae7ee01a
01 Aug, 2024 3 commits
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
- Fix unit tests for the frontend language part (#872) · 6f221d4c
  Ying Sheng authored Aug 01, 2024
  
  6f221d4c
- Add OpenAI backend to the CI test (#869) · 40756776
  Ying Sheng authored Aug 01, 2024
  
  40756776
19 Jul, 2024 1 commit
- Update Readme (#660) · 51fda143
  Ying Sheng authored Jul 19, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  51fda143
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
07 Jun, 2024 1 commit
- Litellm Backend (#502) · 87260b7b
  胡译文 authored Jun 08, 2024
  
  87260b7b
21 May, 2024 1 commit
- Fix openai speculative execution (#456) · 3e684be7
  Ying Sheng authored May 20, 2024
  
  3e684be7
13 May, 2024 1 commit
- Handle truncation errors (#436) · 5dc55a5f
  Lianmin Zheng authored May 13, 2024
  
  5dc55a5f
12 May, 2024 1 commit
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
22 Mar, 2024 1 commit
- Use Anthropic messages API (#304) · e57f0792
  Jani Monoses authored Mar 22, 2024
  
  e57f0792
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
25 Jan, 2024 1 commit
- support speculative execution for openai API (#48) · 23950056
  parasol-aser authored Jan 25, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  23950056
17 Jan, 2024 2 commits
- Improve docs & Rename Gemini -> VertexAI (#19) · bf51ddc6
  Lianmin Zheng authored Jan 17, 2024
  
  bf51ddc6
- Gemini Backend (#9) · fd7c4792
  shiyi.c_98 authored Jan 16, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fd7c4792
15 Jan, 2024 1 commit
- Fix test cases (#6) · 4bd8233f
  Lianmin Zheng authored Jan 15, 2024
  
  4bd8233f
09 Jan, 2024 1 commit
- Add SRT json decode example (#2) · 331848de
  Liangsheng Yin authored Jan 10, 2024
  
  331848de
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081