Commits · 9aa6553d2abd3d0a76629fe1bc02ce9b58f3907e · change / sglang

"vscode:/vscode.git/clone" did not exist on "323f52947b608f1fdad945ca78a51245b618236b"

28 Sep, 2024 1 commit
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d
25 Sep, 2024 1 commit
- [Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510) · fb2d0680
  Lianmin Zheng authored Sep 24, 2024
  
  fb2d0680
22 Sep, 2024 1 commit
- Better unit tests for adding a new model (#1488) · 167591e8
  Lianmin Zheng authored Sep 22, 2024
  
  167591e8
12 Sep, 2024 1 commit
- [Feature] Initial support for multi-LoRA serving (#1307) · 71221692
  Ying Sheng authored Sep 12, 2024
  
  71221692
09 Sep, 2024 1 commit
- [CI] Return output logprobs in unit test (#1361) · 689ff588
  Ying Sheng authored Sep 09, 2024
  
  689ff588
29 Aug, 2024 1 commit
- Sampler cudagraph (#1253) · 381dd57b
  Liangsheng Yin authored Aug 28, 2024
  
  381dd57b
28 Aug, 2024 2 commits
- fix: increase max_new_tokens when testing generation models (#1244) · 66975360
  Yineng Zhang authored Aug 28, 2024
  
  66975360
- hotfix: revert sampler CUDA Graph (#1242) · f25f4dfd
  Yineng Zhang authored Aug 28, 2024
  
  f25f4dfd
26 Aug, 2024 1 commit
- Move sampler into CUDA graph (#1201) · 75ce37f4
  Liangsheng Yin authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  75ce37f4
25 Aug, 2024 4 commits
- Update CI workflows (#1210) · 15f1a49d
  Lianmin Zheng authored Aug 25, 2024
  
  15f1a49d
- Support Alibaba-NLP/gte-Qwen2-7B-instruct embedding Model (#1186) · 30b4f771
  Chayenne authored Aug 26, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  30b4f771
- [Fix] the issue of random order when input is a list (#1199) · 1cb4da5c
  Ying Sheng authored Aug 24, 2024
  
  1cb4da5c
- [CI] Fix the problem of hf runner too slow (#1202) · e61d13ac
  Ying Sheng authored Aug 24, 2024
  
  e61d13ac
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

14 Aug, 2024 2 commits
- [Fix] Compatibility of window attention and cuda graph (#1090) · 96a2093e
  Ying Sheng authored Aug 14, 2024
  
  96a2093e
- [Feat] Add window attention for gemma-2 (#1056) · 0909bb0d
  Ying Sheng authored Aug 13, 2024
  
  0909bb0d
13 Aug, 2024 1 commit
- fix: not use the default port (#1068) · 65e89bae
  Yineng Zhang authored Aug 13, 2024
  
  65e89bae
12 Aug, 2024 1 commit
- fix: Fix returned prefill logits and add output str test (#1046) · 32f61443
  Ying Sheng authored Aug 11, 2024
  
  32f61443
10 Aug, 2024 1 commit
- Support embedding input as a list (#1014) · 7599bade
  Ying Sheng authored Aug 10, 2024
  
  7599bade
08 Aug, 2024 1 commit
- Add e5-mistral embedding model - step 3/3 (#988) · e040a245
  Ying Sheng authored Aug 08, 2024
  
  e040a245
04 Aug, 2024 1 commit
- Add model accuracy test - step 1 (#866) · 70cc0749
  Ying Sheng authored Aug 03, 2024
  
  70cc0749