Commits · 48761171716302446a95c8d9d1fe1a469f12309e · change / sglang

13 Oct, 2024 1 commit
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
12 Oct, 2024 1 commit
- Fix ignore_eos (#1645) · e37cdab0
  Lianmin Zheng authored Oct 12, 2024
  
  e37cdab0
10 Sep, 2024 1 commit
- Support OpenAI API json_schema response format (#1363) · 9144ed10
  zifeitong authored Sep 09, 2024
  
  9144ed10
09 Sep, 2024 1 commit
- [Feat] Add modalities for vision server when handling pixel values for llava (#1346) · 662ecd93
  Kaichen Zhang - NTU authored Sep 09, 2024
  
  662ecd93
30 Aug, 2024 1 commit
- Allow more flexible assistant and system response (#1256) · 51c554d8
  Christopher Chou authored Aug 30, 2024
  
  51c554d8
26 Aug, 2024 1 commit
- [FEAT] JSON constrained support (#1125) · 9935f97b
  havetc authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9935f97b
09 Aug, 2024 1 commit
- Add openai embedding API (#997) · b16e856f
  Ying Sheng authored Aug 09, 2024
  
  b16e856f
08 Aug, 2024 3 commits
- feat: frequency, min_new_tokens, presence, and repetition penalties (#973) · ab787594
  Juwan Yoo authored Aug 08, 2024
  
  ab787594
- support more optioin about usage in stream mode (#985) · 3a79613c
  yichuan~ authored Aug 08, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  3a79613c
- Add io struct for embedding models [unreachable code] - step 2/3 (#987) · 20a4f927
  Ying Sheng authored Aug 08, 2024
  
  20a4f927
07 Aug, 2024 1 commit
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
04 Aug, 2024 1 commit
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
01 Aug, 2024 1 commit
- Add support for logprobs in OpenAI chat API (#852) · ca600e8c
  yichuan~ authored Aug 01, 2024
  
  ca600e8c
29 Jul, 2024 1 commit
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
28 Jul, 2024 1 commit
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
27 Jul, 2024 1 commit
- Fix max_tokens for OpenAI chat completion API (#766) · f95e6617
  Lianmin Zheng authored Jul 27, 2024
  
  f95e6617
20 Jul, 2024 1 commit
- Update OpenAI API (#667) · e3046ea3
  Mingyi authored Jul 19, 2024
  
  e3046ea3
19 Jul, 2024 1 commit
- feat: add benchmark serving (#657) · c126a6cc
  zhyncs authored Jul 20, 2024
  
  c126a6cc
09 Jul, 2024 1 commit
- Fix the default argument of OpenAI Chat completion (#605) · da2e5d65
  Lianmin Zheng authored Jul 09, 2024
  
  da2e5d65
08 Jun, 2024 1 commit
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
21 May, 2024 1 commit
- Abort disconnected requests (#457) · 8dbdc018
  Lianmin Zheng authored May 20, 2024
  
  8dbdc018
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
12 May, 2024 3 commits
- Move openai api server into a separate file (#429) · 3fc97f67
  Lianmin Zheng authored May 12, 2024
  
  3fc97f67
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
- Clean up (#422) · 7023f413
  Lianmin Zheng authored May 11, 2024
  
  7023f413
11 Feb, 2024 1 commit
- Support extra field regex in OpenAI API (#172) · 50afed4e
  Cody Yu authored Feb 10, 2024
  
  50afed4e
30 Jan, 2024 2 commits
- format code · 74b3bfaa
  Lianmin Zheng authored Jan 30, 2024
  
  74b3bfaa
- [Feature] Adds basic support for image content in OpenAI chat routes (#113) · 1d0fbe8e
  Keith Stevens authored Jan 30, 2024
  
  1d0fbe8e
19 Jan, 2024 2 commits
- Support v1/chat/completions (#50) · 23471f9a
  Cody Yu authored Jan 18, 2024
  
  23471f9a
- Support stream=True in v1/completions (#49) · 61d4c939
  Cody Yu authored Jan 18, 2024
  
  61d4c939
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081