Commits · 9fc3e8aac7422826a7fad3477ddafe74e03e6420 · zhaoyu6 / sglang

27 Oct, 2025 1 commit
- Add support for Matryoshka embeddings (#126) (#11142) · 9fc3e8aa
  satyamk7054 authored Oct 27, 2025
```
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
```
  9fc3e8aa
17 Oct, 2025 1 commit
- Revert "Set csgmv as default lora backend. (#11488)" (#11735) · da681f35
  Yineng Zhang authored Oct 17, 2025
  
  da681f35
16 Oct, 2025 1 commit
- Set csgmv as default lora backend. (#11488) · b0d20cde
  Lifu Huang authored Oct 15, 2025
  
  b0d20cde
14 Oct, 2025 1 commit
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
05 Sep, 2025 1 commit
- [Fix] Add speculative_draft_model_revision to server_args (#5255) · 13705dae
  DevashishLal-CB authored Sep 05, 2025
```
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
```
  13705dae
20 Aug, 2025 1 commit
- Support pinning adapter via server args. (#9249) · b0980af8
  Lifu Huang authored Aug 20, 2025
  
  b0980af8
17 Aug, 2025 1 commit
- model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) · 845d12a9
  Netanel Haber authored Aug 17, 2025
```
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
```
  845d12a9
07 Aug, 2025 1 commit
- Support GPU pinning for LoRA (#8697) · 6210e2c4
  Lifu Huang authored Aug 06, 2025
  
  6210e2c4
03 Aug, 2025 1 commit
- Support limiting max loaded loras in CPU. (#8650) · 8675bdf2
  Lifu Huang authored Aug 03, 2025
  
  8675bdf2
01 Aug, 2025 1 commit
- [5/N] MoE Refactor: Update MoE parallelism arguments (#8658) · 6c88f6c8
  Cheng Wan authored Aug 01, 2025
  
  6c88f6c8
28 Jul, 2025 1 commit
- [feat] Support different attention backends for prefill and decode (#6338) · 28103384
  Qiaolin Yu authored Jul 27, 2025
```
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  28103384
20 Jul, 2025 1 commit
- Add get_hidden_dim to qwen3.py for correct lora (#7312) · 877e35d7
  Pavel Logachev authored Jul 20, 2025
  
  877e35d7
19 Jul, 2025 2 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Clean up server args (#8161) · bb0e8a32
  Lianmin Zheng authored Jul 19, 2025
  
  bb0e8a32
14 Jul, 2025 1 commit
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
28 Jun, 2025 2 commits
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
04 Jun, 2025 1 commit
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
26 May, 2025 1 commit
- chore: upgrade transformers 4.52.3 (#6575) · 7eb9d8e5
  Yineng Zhang authored May 25, 2025
```
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  7eb9d8e5
13 May, 2025 1 commit
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
01 May, 2025 1 commit
- Fix lora batch processing when input lora_path contains None (#5930) · 7bcd8b1c
  Qiaolin Yu authored Apr 30, 2025
  
  7bcd8b1c
30 Apr, 2025 1 commit
- [Fix] Unload lora in HF_Runner if needed (#5899) · 58195dd5
  Qiaolin Yu authored Apr 29, 2025
  
  58195dd5
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
17 Apr, 2025 1 commit
- Feat/support encoder model (like bert) (#4887) · 3bface15
  woodx authored Apr 17, 2025
  
  3bface15
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
27 Mar, 2025 1 commit
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
19 Mar, 2025 1 commit
- [Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274) · 588865f0
  aoshen524 authored Mar 18, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  588865f0
07 Mar, 2025 1 commit
- Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) · 361971b8
  uylnap authored Mar 07, 2025
  
  361971b8
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

28 Feb, 2025 1 commit
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
20 Feb, 2025 1 commit
- [Fix] Fix bugs and refactor codes in lora for better scalability. (#3652) · e79f7420
  aoshen524 authored Feb 20, 2025
```
Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  e79f7420
04 Feb, 2025 1 commit
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
20 Jan, 2025 2 commits
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
21 Nov, 2024 1 commit
- Add support for Qwen2-VL-based embedding models (#2055) · f6f71379
  James Xu authored Nov 21, 2024
  
  f6f71379
03 Nov, 2024 1 commit
- Let reward model take text inputs instead of message lists (#1907) · 2ce32db6
  Lianmin Zheng authored Nov 03, 2024
```
Co-authored-by: Kyle Corbitt <kyle@corbt.com>
```
  2ce32db6
21 Oct, 2024 1 commit
- Fix sliding window attention and gemma-2 unit tests in CI (#1746) · 00611286
  Lianmin Zheng authored Oct 21, 2024
  
  00611286