Commits · cfe2edac3861538d01e93c89605dbf46ae4cf2a7 · change / sglang

28 Jun, 2025 1 commit
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
04 Jun, 2025 1 commit
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
26 May, 2025 1 commit
- chore: upgrade transformers 4.52.3 (#6575) · 7eb9d8e5
  Yineng Zhang authored May 25, 2025
```
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  7eb9d8e5
13 May, 2025 1 commit
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
01 May, 2025 1 commit
- Fix lora batch processing when input lora_path contains None (#5930) · 7bcd8b1c
  Qiaolin Yu authored Apr 30, 2025
  
  7bcd8b1c
30 Apr, 2025 1 commit
- [Fix] Unload lora in HF_Runner if needed (#5899) · 58195dd5
  Qiaolin Yu authored Apr 29, 2025
  
  58195dd5
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
17 Apr, 2025 1 commit
- Feat/support encoder model (like bert) (#4887) · 3bface15
  woodx authored Apr 17, 2025
  
  3bface15
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
27 Mar, 2025 1 commit
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
19 Mar, 2025 1 commit
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
07 Mar, 2025 1 commit
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

28 Feb, 2025 1 commit
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
20 Feb, 2025 1 commit
- [Fix] Fix bugs and refactor codes in lora for better scalability. (#3652) · e79f7420
  aoshen524 authored Feb 20, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  e79f7420
04 Feb, 2025 1 commit
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
20 Jan, 2025 2 commits
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
21 Nov, 2024 1 commit
- Add support for Qwen2-VL-based embedding models (#2055) · f6f71379
  James Xu authored Nov 21, 2024
  
  f6f71379
03 Nov, 2024 1 commit
- Let reward model take text inputs instead of message lists (#1907) · 2ce32db6
  Lianmin Zheng authored Nov 03, 2024
```
Co-authored-by: Kyle Corbitt <kyle@corbt.com>
```
  2ce32db6
21 Oct, 2024 1 commit
- Fix sliding window attention and gemma-2 unit tests in CI (#1746) · 00611286
  Lianmin Zheng authored Oct 21, 2024
  
  00611286
30 Sep, 2024 1 commit
- Let ModelRunner take InputMetadata as input, instead of ScheduleBatch (#1541) · 3f0fe08d
  Lianmin Zheng authored Sep 29, 2024
  
  3f0fe08d
28 Sep, 2024 1 commit
- [Feature] Support reward model LxzGordon/URM-LLaMa-3.1-8B (#1525) · 9aa6553d
  Ying Sheng authored Sep 27, 2024
  
  9aa6553d
25 Sep, 2024 1 commit
- [Fix] Fix clean_up_tokenization_spaces in tokenizer (#1510) · fb2d0680
  Lianmin Zheng authored Sep 24, 2024
  
  fb2d0680
22 Sep, 2024 1 commit
- Better unit tests for adding a new model (#1488) · 167591e8
  Lianmin Zheng authored Sep 22, 2024
  
  167591e8
12 Sep, 2024 1 commit
- [Feature] Initial support for multi-LoRA serving (#1307) · 71221692
  Ying Sheng authored Sep 12, 2024
  
  71221692
09 Sep, 2024 1 commit
- [CI] Return output logprobs in unit test (#1361) · 689ff588
  Ying Sheng authored Sep 09, 2024
  
  689ff588
29 Aug, 2024 1 commit
- Sampler cudagraph (#1253) · 381dd57b
  Liangsheng Yin authored Aug 28, 2024
  
  381dd57b
28 Aug, 2024 2 commits
- fix: increase max_new_tokens when testing generation models (#1244) · 66975360
  Yineng Zhang authored Aug 28, 2024
  
  66975360
- hotfix: revert sampler CUDA Graph (#1242) · f25f4dfd
  Yineng Zhang authored Aug 28, 2024
  
  f25f4dfd
26 Aug, 2024 1 commit
- Move sampler into CUDA graph (#1201) · 75ce37f4
  Liangsheng Yin authored Aug 26, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  75ce37f4
25 Aug, 2024 4 commits
- Update CI workflows (#1210) · 15f1a49d
  Lianmin Zheng authored Aug 25, 2024
  
  15f1a49d
- Support Alibaba-NLP/gte-Qwen2-7B-instruct embedding Model (#1186) · 30b4f771
  Chayenne authored Aug 26, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  30b4f771
- [Fix] the issue of random order when input is a list (#1199) · 1cb4da5c
  Ying Sheng authored Aug 24, 2024
  
  1cb4da5c
- [CI] Fix the problem of hf runner too slow (#1202) · e61d13ac
  Ying Sheng authored Aug 24, 2024
  
  e61d13ac
24 Aug, 2024 1 commit
- Cleanup readme, llava examples, usage examples and nccl init (#1194) · f6af3a65
  Lianmin Zheng authored Aug 24, 2024
  
  f6af3a65
19 Aug, 2024 1 commit

[Feat]Add support for optional start len of logprobs (#1035) · b997a18d

yichuan~ authored Aug 18, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

b997a18d

14 Aug, 2024 1 commit
- [Fix] Compatibility of window attention and cuda graph (#1090) · 96a2093e
  Ying Sheng authored Aug 14, 2024
  
  96a2093e