Commits · 5a261bd0552c049f7eb14dfd20a1ae43f61c9f46 · zhaoyu6 / sglang

16 Aug, 2024 1 commit
- Fix the deadlock in multi-node tp (#1122) · 5a261bd0
  Lianmin Zheng authored Aug 16, 2024
  
  5a261bd0
14 Aug, 2024 1 commit
- Update grok 1 model (#1095) · a59636bb
  Lianmin Zheng authored Aug 14, 2024
  
  a59636bb
12 Aug, 2024 1 commit
- fix: Fix returned prefill logits and add output str test (#1046) · 32f61443
  Ying Sheng authored Aug 11, 2024
  
  32f61443
07 Aug, 2024 1 commit
- Organize code (rename, movement) (#953) · 87e8c090
  Liangsheng Yin authored Aug 06, 2024
  
  87e8c090
01 Aug, 2024 1 commit
- Improve the coverage of the openai api server test (#878) · 60340a36
  Ying Sheng authored Aug 01, 2024
  
  60340a36
30 Jul, 2024 1 commit
- Code structure refactor (#807) · cdcbde5f
  Liangsheng Yin authored Jul 29, 2024
  
  cdcbde5f
28 Jul, 2024 5 commits
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
- Vectorize logprobs computation (#787) · c71880f8
  Ying Sheng authored Jul 28, 2024
  
  c71880f8
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
- Fix return_log_probs with cuda graph (#775) · 0a409bd4
  Lianmin Zheng authored Jul 27, 2024
  
  0a409bd4
- Move sampling logits to float32 (#773) · bbc07c41
  Lianmin Zheng authored Jul 27, 2024
  
  bbc07c41
21 Jul, 2024 1 commit
- Support gpt-bigcode model class (#681) · caaad53b
  Liangsheng Yin authored Jul 20, 2024
  
  caaad53b
09 Jul, 2024 1 commit
- add `LogitsMetadata` (#604) · f25b76c0
  Liangsheng Yin authored Jul 08, 2024
  
  f25b76c0
05 Jul, 2024 1 commit
- Add Gemma2 (#592) · 5a57b8ad
  Ying Sheng authored Jul 05, 2024
  
  5a57b8ad
22 Jun, 2024 1 commit
- Clean up logits processor (#558) · 303ef888
  Lianmin Zheng authored Jun 22, 2024
  
  303ef888
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
08 Jun, 2024 1 commit
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

25 May, 2024 1 commit
- Optimize retract (#440) · f06e90c2
  Liangsheng Yin authored May 26, 2024
  
  f06e90c2
12 May, 2024 1 commit
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
11 May, 2024 2 commits
- Optimize the memory usage of logits processor (#420) · 09deb20d
  Lianmin Zheng authored May 11, 2024
  
  09deb20d
- Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380) · 33b242df
  Qubitium authored May 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
```
  33b242df
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
06 Feb, 2024 2 commits
- Format code & move functions (#155) · 23f05005
  Lianmin Zheng authored Feb 06, 2024
  
  23f05005
- Support decode token logprobs (#130) · a7334aee
  Cody Yu authored Feb 06, 2024
  
  a7334aee
23 Jan, 2024 1 commit
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0
21 Jan, 2024 2 commits
- Fix select and normalized logprobs (#67) · a837166e
  Lianmin Zheng authored Jan 21, 2024
  
  a837166e
- Fix select (#64) · 11f3cca6
  Lianmin Zheng authored Jan 20, 2024
  
  11f3cca6
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081