Commits · 8e6bdf851c4aa6619baa584fc450af748720319d · zhaoyu6 / sglang

29 Aug, 2024 1 commit
- fix data racing due to mutable reference using deepcopy (#1255) · 8153168c
  Zhiqiang Xie authored Aug 28, 2024
  
  8153168c
28 Aug, 2024 1 commit
- [Fix] Fix llava on multi images (#1247) · bf53bf51
  Lianmin Zheng authored Aug 28, 2024
  
  bf53bf51
21 Aug, 2024 1 commit
- Improve code style of sampler (#1168) · 83e23c69
  Liangsheng Yin authored Aug 21, 2024
  
  83e23c69
20 Aug, 2024 1 commit
- [Feat] Support update weights without restart server (#1157) · cd10654e
  Shan Yu authored Aug 20, 2024
  
  cd10654e
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

17 Aug, 2024 1 commit
- Improve the code style: more comments and remove useless packages (#1139) · cdc8d607
  Lianmin Zheng authored Aug 17, 2024
  
  cdc8d607
10 Aug, 2024 1 commit
- fix: force max new tokens to be 1 for embedding request (#1019) · b68c4c07
  Ying Sheng authored Aug 10, 2024
  
  b68c4c07
09 Aug, 2024 1 commit
- Add openai embedding API (#997) · b16e856f
  Ying Sheng authored Aug 09, 2024
  
  b16e856f
08 Aug, 2024 1 commit
- Add io struct for embedding models [unreachable code] - step 2/3 (#987) · 20a4f927
  Ying Sheng authored Aug 08, 2024
  
  20a4f927
04 Aug, 2024 1 commit
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
30 Jul, 2024 1 commit
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
29 Jul, 2024 1 commit
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
28 Jul, 2024 2 commits
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
26 Jul, 2024 2 commits
- misc: format (#741) · 6b32bb1c
  Yineng Zhang authored Jul 26, 2024
  
  6b32bb1c
- fix /generate without sampling_params (#734) · da504445
  Toshiki Kataoka authored Jul 26, 2024
  
  da504445
20 Jul, 2024 3 commits
- Fix illegal tokens during sampling (#676) · f424e76d
  Liangsheng Yin authored Jul 20, 2024
  
  f424e76d
- Support random dataset in bench_serving.py (#669) · 35759efa
  Lianmin Zheng authored Jul 20, 2024
  
  35759efa
- Add support for OpenAI API parallel sampling (#640) · 49c5e0ec
  yichuan~ authored Jul 20, 2024
  
  49c5e0ec
19 Jul, 2024 3 commits
- Fix jump forward when streaming (#665) · 7620cd37
  Liangsheng Yin authored Jul 19, 2024
  
  7620cd37
- Improve docs (#662) · e87c7fd5
  Ying Sheng authored Jul 19, 2024
  
  e87c7fd5
- Detokenize incrementally when streaming (#653) · a9ef49c1
  Liangsheng Yin authored Jul 18, 2024
  
  a9ef49c1
07 Jul, 2024 1 commit
- Fix streaming (#600) · 0877f1e7
  Liangsheng Yin authored Jul 07, 2024
  
  0877f1e7
06 Jul, 2024 1 commit
- * fix(detokenizer_manager.py): fix truncated decoded output (#586) · 26908d95
  uylnap authored Jul 07, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  26908d95
30 Jun, 2024 1 commit
- Minor fix in compiler & format (#545) · 11616fc6
  sglang authored Jun 29, 2024
  
  11616fc6
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
12 Jun, 2024 1 commit
- Decode Incrementally (#517) · 9c902b19
  Liangsheng Yin authored Jun 12, 2024
  
  9c902b19
08 Jun, 2024 1 commit
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
07 Jun, 2024 1 commit
- Fix rid state map leak + Refractor .finished (#505) · f70f7258
  Qubitium authored Jun 08, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
```
  f70f7258
28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

25 May, 2024 1 commit
- Optimize retract (#440) · f06e90c2
  Liangsheng Yin authored May 26, 2024
  
  f06e90c2
19 May, 2024 1 commit
- openai chat speculative execution (#250) · ec380dfd
  LiviaSun authored May 18, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  ec380dfd
17 May, 2024 1 commit
- Improve error handling & abort disconnected requests (#449) · 8210ec60
  Lianmin Zheng authored May 17, 2024
  
  8210ec60
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
12 May, 2024 3 commits
- Allow `input_ids` in the input of the `/generate` endpoint (#363) · 04c0b214
  Shannon Shen authored May 12, 2024
  
  04c0b214
- Minor fix for the import path (#428) · abc548c7
  Lianmin Zheng authored May 12, 2024
  
  abc548c7
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
30 Apr, 2024 1 commit
- SamplingParams add "spaces_between_special_tokens" argument (#392) · 183df472
  ZhouXingg authored May 01, 2024
  
  183df472
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
15 Feb, 2024 1 commit
- Refactor decoding logprob and add completion_tokens_wo_jump_forward (#189) · 63ba630b
  Cody Yu authored Feb 15, 2024
  
  63ba630b