Commits · 67e53b16f5f18fdfb2a08a42b77af8dd29057459 · change / sglang

31 Jul, 2025 1 commit
- Bump transfomers to 4.54.1 to fix Gemma cache issue. (#8541) · 67e53b16
  Lifu Huang authored Jul 30, 2025
  
  67e53b16
28 Jul, 2025 1 commit

chore: bump transformer to 4.54.0 (#8416) · 4ad97370

Stefan He authored Jul 27, 2025


Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>

4ad97370

23 Jul, 2025 1 commit
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77
20 Jul, 2025 3 commits
- Feat: Support for Persimmon Model (#7983) · 83c104b1
  Praneth Paruchuri authored Jul 20, 2025
  
  83c104b1
- Add get_hidden_dim to qwen3.py for correct lora (#7312) · 877e35d7
  Pavel Logachev authored Jul 20, 2025
  
  877e35d7
- Enable FlashInfer support encoder models and add head_dim padding workaround (#6230) · cbdfb771
  Clay authored Jul 20, 2025
  
  cbdfb771
19 Jul, 2025 3 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Fix LoRA buffer contamination during adapter eviction (#8103) · 3de617a7
  Lifu Huang authored Jul 19, 2025
  
  3de617a7
- Clean up server args (#8161) · bb0e8a32
  Lianmin Zheng authored Jul 19, 2025
  
  bb0e8a32
14 Jul, 2025 2 commits
- Support for Phi-1.5 & Phi-2 models (#7862) · cb736df8
  Praneth Paruchuri authored Jul 14, 2025
  
  cb736df8
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
10 Jul, 2025 1 commit
- Feat: Support Phi-3.5-MoE in SGLang (#7907) · 2d54d4bb
  Binyao Jiang authored Jul 09, 2025
  
  2d54d4bb
05 Jul, 2025 1 commit
- Fix CI test OOM issue. (#7799) · 01f98730
  Lifu Huang authored Jul 05, 2025
  
  01f98730
04 Jul, 2025 1 commit
- Add V2-lite model test (#7390) · 4de03953
  YanbingJiang authored Jul 04, 2025
```
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  4de03953
02 Jul, 2025 1 commit
- Improve error handling for requests with unloaded LoRA path(s) (#7642) · 1a08358a
  Lifu Huang authored Jul 01, 2025
  
  1a08358a
28 Jun, 2025 2 commits
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
10 Jun, 2025 1 commit
- Fix test_lora.py CI (#7061) · 3b014bc1
  Baizhou Zhang authored Jun 10, 2025
  
  3b014bc1
09 Jun, 2025 1 commit
- support qwen3 emebedding (#6990) · 451ffe74
  uylnap authored Jun 09, 2025
  
  451ffe74
04 Jun, 2025 1 commit
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
01 Jun, 2025 1 commit
- Update CI tests for Llama4 models (#6421) · c6a0cacc
  Ravi Theja authored Jun 01, 2025
  
  c6a0cacc
22 May, 2025 1 commit
- Support XiaomiMiMo inference with mtp (#6059) · a6ae3af1
  ryang authored May 23, 2025
  
  a6ae3af1
21 May, 2025 1 commit
- aiter attention-backend (default enabled on AMD/ROCm) (#6381) · 5c0b38f3
  HAI authored May 20, 2025
  
  5c0b38f3
13 May, 2025 1 commit
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
11 May, 2025 1 commit
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
04 May, 2025 1 commit
- Fix flaky issues of lora and add multi batch tests (#5957) · 3042f1da
  Qiaolin Yu authored May 04, 2025
  
  3042f1da
01 May, 2025 1 commit
- Fix lora batch processing when input lora_path contains None (#5930) · 7bcd8b1c
  Qiaolin Yu authored Apr 30, 2025
  
  7bcd8b1c
29 Apr, 2025 1 commit
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
28 Apr, 2025 1 commit
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
27 Apr, 2025 1 commit
- [feature] support for roberta embedding models (#5730) · d8fbc7c0
  DavidBao authored Apr 27, 2025
  
  d8fbc7c0
25 Apr, 2025 1 commit
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
19 Apr, 2025 1 commit
- restruct compressed_tensors_w8a8_fp8 (#5475) · bf86c5e9
  Xiaoyu Zhang authored Apr 19, 2025
  
  bf86c5e9
17 Apr, 2025 2 commits

Feat/support encoder model (like bert) (#4887) · 3bface15
woodx authored Apr 17, 2025

3bface15

[Model Support] unsloth/Phi-4-mini bnb model (#4982) · 8f783c19

eigen authored Apr 16, 2025


Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

8f783c19

09 Apr, 2025 2 commits
- update grok test (#5171) · 7f875f12
  saienduri authored Apr 09, 2025
  
  7f875f12
- Tiny disable model that does not work (#5175) · 39efad4f
  fzyzcjy authored Apr 09, 2025
  
  39efad4f