Commits · 30b4f771b0c515c18179f3e1ee0b4662b2606a95 · change / sglang

25 Aug, 2024 3 commits
- Support Alibaba-NLP/gte-Qwen2-7B-instruct embedding Model (#1186) · 30b4f771
  Chayenne authored Aug 26, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  30b4f771
- [Fix] Fixing the multi-images error for llava-onevision (#1205) · 66e7dcaf
  Kaichen Zhang - NTU authored Aug 26, 2024
  
  66e7dcaf
- [Fix] the issue of random order when input is a list (#1199) · 1cb4da5c
  Ying Sheng authored Aug 24, 2024
  
  1cb4da5c
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
23 Aug, 2024 1 commit

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2... · a5b14ad0

Kaichen Zhang - NTU authored Aug 24, 2024


[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)
Co-authored-by: Bo Li <drluodian@gmail.com>

a5b14ad0

22 Aug, 2024 1 commit
- [Minor] Improve logging and rename the health check endpoint name (#1180) · 5623826f
  Lianmin Zheng authored Aug 21, 2024
  
  5623826f
21 Aug, 2024 1 commit
- Improve code style of sampler (#1168) · 83e23c69
  Liangsheng Yin authored Aug 21, 2024
  
  83e23c69
20 Aug, 2024 2 commits
- [Feat] Support update weights without restart server (#1157) · cd10654e
  Shan Yu authored Aug 20, 2024
  
  cd10654e
- feat: allow streaming for multi-prompt and/or parallel sampling (#1134) · d8476818
  Juwan Yoo authored Aug 20, 2024
  
  d8476818
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

13 Aug, 2024 1 commit
- Fix create_abort_task, GenerateReqInput does not have rids. (#1079) · 95f5fbf1
  rainred authored Aug 13, 2024
```
Co-authored-by: lzhang <zhanglei@modelbest.cn>
```
  95f5fbf1
10 Aug, 2024 1 commit
- Support embedding input as a list (#1014) · 7599bade
  Ying Sheng authored Aug 10, 2024
  
  7599bade
09 Aug, 2024 2 commits
- Add skip_tokenizer_init args. (#959) · 9cf0a5ba
  gryffindor-rr authored Aug 10, 2024
```
Co-authored-by: lzhang <zhanglei@modelbest.cn>
```
  9cf0a5ba
- Add openai embedding API (#997) · b16e856f
  Ying Sheng authored Aug 09, 2024
  
  b16e856f
08 Aug, 2024 2 commits
- Add e5-mistral embedding model - step 3/3 (#988) · e040a245
  Ying Sheng authored Aug 08, 2024
  
  e040a245
- [minor] Update type annotation in tokenizer_manager.py (#982) · 00023d62
  Ying Sheng authored Aug 07, 2024
  
  00023d62
07 Aug, 2024 1 commit
- Add support for Batch API test (#936) · 795eab6d
  yichuan~ authored Aug 07, 2024
  
  795eab6d
05 Aug, 2024 1 commit
- Test openai vision api (#925) · 3bc99e6f
  Ying Sheng authored Aug 04, 2024
  
  3bc99e6f
04 Aug, 2024 1 commit
- Support more OpenAI API test (#916) · d53dcf9c
  yichuan~ authored Aug 05, 2024
  
  d53dcf9c
02 Aug, 2024 1 commit
- Implement served_model_name to customize model id when use local mode… (#749) · 4013a4e1
  任嘉 authored Aug 02, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  4013a4e1
29 Jul, 2024 1 commit
- Add support for OpenAI API : offline batch(file) processing (#699) · 084fa54d
  yichuan~ authored Jul 30, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  084fa54d
28 Jul, 2024 3 commits
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
- Vectorize logprobs computation (#787) · c71880f8
  Ying Sheng authored Jul 28, 2024
  
  c71880f8
- Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs... · 30db99b3
  Lianmin Zheng authored Jul 27, 2024
```
Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776)
```
  30db99b3
27 Jul, 2024 1 commit
- [Minor] Improve the code style in TokenizerManager (#767) · 0736b270
  Lianmin Zheng authored Jul 27, 2024
  
  0736b270
20 Jul, 2024 2 commits
- Support random dataset in bench_serving.py (#669) · 35759efa
  Lianmin Zheng authored Jul 20, 2024
  
  35759efa
- Add support for OpenAI API parallel sampling (#640) · 49c5e0ec
  yichuan~ authored Jul 20, 2024
  
  49c5e0ec
19 Jul, 2024 1 commit
- `TokenizerManager.context_len` should inherit from `server_args.conte… (#654) · 1b7adbb5
  shrirajh authored Jul 19, 2024
  
  1b7adbb5
18 Jul, 2024 1 commit
- Remove the dependency of rpyc (#646) · d774acad
  Mingyi authored Jul 18, 2024
  
  d774acad
17 Jul, 2024 1 commit
- misc: add pre-commit config (#637) · 2e341cd4
  zhyncs authored Jul 18, 2024
  
  2e341cd4
09 Jul, 2024 2 commits
- [Feat] Expose logprob options to `sgl.gen` API (#503) · 02b72586
  胡译文 authored Jul 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  02b72586
- add `LogitsMetadata` (#604) · f25b76c0
  Liangsheng Yin authored Jul 08, 2024
  
  f25b76c0
07 Jul, 2024 1 commit
- Fix streaming (#600) · 0877f1e7
  Liangsheng Yin authored Jul 07, 2024
  
  0877f1e7
06 Jul, 2024 1 commit
- * fix(detokenizer_manager.py): fix truncated decoded output (#586) · 26908d95
  uylnap authored Jul 07, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  26908d95
05 Jul, 2024 1 commit
- Format (#593) · dc1b8bcf
  Ying Sheng authored Jul 05, 2024
  
  dc1b8bcf
30 Jun, 2024 1 commit
- Minor fix in compiler & format (#545) · 11616fc6
  sglang authored Jun 29, 2024
  
  11616fc6
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
08 Jun, 2024 1 commit
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
07 Jun, 2024 1 commit
- Fix rid state map leak + Refractor .finished (#505) · f70f7258
  Qubitium authored Jun 08, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
```
  f70f7258
21 May, 2024 1 commit
- Abort disconnected requests (#457) · 8dbdc018
  Lianmin Zheng authored May 20, 2024
  
  8dbdc018