Commits · f70f72586ad26c1738a0d6dc6fbcaa878997b68c · change / sglang

28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

24 May, 2024 1 commit
- Improve logging & add logit cap (#471) · 2cea6146
  Lianmin Zheng authored May 24, 2024
  
  2cea6146
21 May, 2024 1 commit
- Abort disconnected requests (#457) · 8dbdc018
  Lianmin Zheng authored May 20, 2024
  
  8dbdc018
19 May, 2024 1 commit
- openai chat speculative execution (#250) · ec380dfd
  LiviaSun authored May 18, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  ec380dfd
17 May, 2024 3 commits
- Improve error handling & abort disconnected requests (#449) · 8210ec60
  Lianmin Zheng authored May 17, 2024
  
  8210ec60
- Add PUT for generate api (#448) · 5be9eb8a
  Ying Sheng authored May 17, 2024
  
  5be9eb8a
- Simplify port allocation (#447) · c05956e5
  Lianmin Zheng authored May 16, 2024
  
  c05956e5
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
13 May, 2024 2 commits
- support llava video (#426) · 0992d85f
  Yuanhan Zhang authored May 14, 2024
  
  0992d85f
- Handle truncation errors (#436) · 5dc55a5f
  Lianmin Zheng authored May 13, 2024
  
  5dc55a5f
12 May, 2024 3 commits
- Move openai api server into a separate file (#429) · 3fc97f67
  Lianmin Zheng authored May 12, 2024
  
  3fc97f67
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
- Clean up (#422) · 7023f413
  Lianmin Zheng authored May 11, 2024
  
  7023f413
11 May, 2024 1 commit
- Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380) · 33b242df
  Qubitium authored May 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
```
  33b242df
25 Apr, 2024 1 commit
- Minor: style improvement of radix_cache and memory_pool (#395) · 19818b9c
  Liangsheng Yin authored Apr 26, 2024
  
  19818b9c
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
09 Apr, 2024 1 commit
- Time cost utils (#355) · 62b3812b
  Liangsheng Yin authored Apr 09, 2024
  
  62b3812b
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
11 Mar, 2024 5 commits
- Fix Runtime missing some ServerArgs options (#281) · b2eb0805
  Qubitium authored Mar 11, 2024
  
  b2eb0805
- Fix RuntimeEndpoint (#279) · 13662fd5
  Lianmin Zheng authored Mar 11, 2024
  
  13662fd5
- Add Support for API Key Authentication (#230) · d5ae2eba
  Alessio Dalla Piazza authored Mar 11, 2024
  
  d5ae2eba
- Organize `server_args` (#277) · 1b355479
  Liangsheng Yin authored Mar 11, 2024
  
  1b355479
- Improve gemma and documentations (#278) · faba293a
  Lianmin Zheng authored Mar 11, 2024
  
  faba293a
21 Feb, 2024 1 commit
- Added the ability to Modify the Context Length (#210) · 9de9a468
  psych0v0yager authored Feb 20, 2024
  
  9de9a468
15 Feb, 2024 1 commit
- Refactor decoding logprob and add completion_tokens_wo_jump_forward (#189) · 63ba630b
  Cody Yu authored Feb 15, 2024
  
  63ba630b
12 Feb, 2024 1 commit
- Fix server launch for jupyter notebook (#186) · 06008bc2
  Lianmin Zheng authored Feb 12, 2024
  
  06008bc2
11 Feb, 2024 2 commits
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
- Support extra field regex in OpenAI API (#172) · 50afed4e
  Cody Yu authored Feb 10, 2024
  
  50afed4e
09 Feb, 2024 1 commit
- import outlines (#168) · 37b42297
  Liangsheng Yin authored Feb 09, 2024
  
  37b42297
07 Feb, 2024 1 commit
- add `--disable-disk-cache` (#160) · b1a3a454
  Liangsheng Yin authored Feb 08, 2024
```
Co-authored-by: Ja1Zhou <50169346+Ja1Zhou@users.noreply.github.com>
```
  b1a3a454
06 Feb, 2024 3 commits
- Format code & move functions (#155) · 23f05005
  Lianmin Zheng authored Feb 06, 2024
  
  23f05005
- Support decode token logprobs (#130) · a7334aee
  Cody Yu authored Feb 06, 2024
  
  a7334aee
- Temporary fix OpenAI API for Pydantic v1/v2 (#153) · ccbe1e67
  Cody Yu authored Feb 06, 2024
  
  ccbe1e67
05 Feb, 2024 1 commit
- Add warmup to SRT server (#146) · 322421fa
  Cody Yu authored Feb 05, 2024
  
  322421fa
03 Feb, 2024 1 commit
- Add max_prefill_num_token into server arguments (#133) · e095b162
  Ying Sheng authored Feb 03, 2024
  
  e095b162
30 Jan, 2024 4 commits
- format code · 74b3bfaa
  Lianmin Zheng authored Jan 30, 2024
  
  74b3bfaa
- [Feature] Allow specifying all ports to use in advance (#116) · 4a634cf6
  Jay Zhou authored Jan 30, 2024
  
  4a634cf6
- Ignore detokenization error · 873d0e85
  Lianmin Zheng authored Jan 30, 2024
  
  873d0e85
- [Feature] Adds basic support for image content in OpenAI chat routes (#113) · 1d0fbe8e
  Keith Stevens authored Jan 30, 2024
  
  1d0fbe8e