Commits · d6837aea4d2c1e32b19706ecd4d807df82dacfce · change / sglang · GitLab

08 Oct, 2025 1 commit
- model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) · d6837aea
  Netanel Haber authored Oct 08, 2025
```
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
```
  d6837aea
03 Oct, 2025 2 commits
- [minor] fix the lint (#11198) · 4726c919
  Liangsheng Yin authored Oct 04, 2025
  
  4726c919
- [Test] Initialize mem_fraction_static in setUpClass to fix pytest VLM test crashes. (#10859) · 586e81a2
  vikram singh shekhawat authored Oct 03, 2025
```
Co-authored-by: svc_repro_tool <svc_repro_tool@habana.ai>
```
  586e81a2
02 Oct, 2025 1 commit

[model] Add mamba2 and Falcon-H1 support. (#10988) · 083629c2

ilyasch2 authored Oct 02, 2025


Co-authored-by: Younes Belkada <younes.belkada@tii.ae>
Co-authored-by: Younes B <49240599+younesbelkada@users.noreply.github.com>

083629c2

15 Sep, 2025 3 commits
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12
- model: support solar (#8189) · a45d9a4e
  Praneth Paruchuri authored Sep 15, 2025
  
  a45d9a4e
- [router]: Add Embedding routing logic (#10129) · f9ee6ae1
  Jintao Zhang authored Sep 15, 2025
```
Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
Co-authored-by: Waël Boukhobza <wawa_wael@live.fr>
```
  f9ee6ae1
12 Sep, 2025 2 commits
- add qwen3-next ut (#10355) · fe6cdf89
  Yi Zhang authored Sep 12, 2025
  
  fe6cdf89
- model: support Apertus (#9774) · 46d8fb1c
  EduardDurech authored Sep 12, 2025
  
  46d8fb1c
09 Sep, 2025 1 commit
- Support opt model (#10165) · 16ff3d4b
  wenhuipeng authored Sep 09, 2025
  
  16ff3d4b
02 Sep, 2025 1 commit

[model] support MiniCPM-V 4.0 (#8747) · 03dbf1aa

tc-mb authored Sep 03, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

03dbf1aa

26 Aug, 2025 1 commit
- model: Support nvidia/Llama-3_1-Nemotron-Ultra-253B-v1 (#9301) · 4cd08dc5
  Netanel Haber authored Aug 26, 2025
  
  4cd08dc5
17 Aug, 2025 1 commit
- model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) · 845d12a9
  Netanel Haber authored Aug 17, 2025
```
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
```
  845d12a9
10 Aug, 2025 1 commit
- Reorganize CI and test files (#9027) · 2c7f01bc
  Lianmin Zheng authored Aug 10, 2025
  
  2c7f01bc
07 Aug, 2025 2 commits
- [Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292) · 2d120f8b
  Zheng Wengang authored Aug 07, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  2d120f8b
- Support GPU pinning for LoRA (#8697) · 6210e2c4
  Lifu Huang authored Aug 06, 2025
  
  6210e2c4
06 Aug, 2025 1 commit
- Support bailing moe (#8680) · d26ca84f
  Praneth Paruchuri authored Aug 06, 2025
  
  d26ca84f
03 Aug, 2025 1 commit
- Support limiting max loaded loras in CPU. (#8650) · 8675bdf2
  Lifu Huang authored Aug 03, 2025
  
  8675bdf2
01 Aug, 2025 1 commit
- Increase tolerance to address CI failures (#8643) · 46e9d1c7
  Lifu Huang authored Aug 01, 2025
  
  46e9d1c7
31 Jul, 2025 1 commit
- Bump transfomers to 4.54.1 to fix Gemma cache issue. (#8541) · 67e53b16
  Lifu Huang authored Jul 30, 2025
  
  67e53b16
28 Jul, 2025 1 commit

chore: bump transformer to 4.54.0 (#8416) · 4ad97370

Stefan He authored Jul 27, 2025


Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>

4ad97370

23 Jul, 2025 1 commit
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77
20 Jul, 2025 3 commits
- Feat: Support for Persimmon Model (#7983) · 83c104b1
  Praneth Paruchuri authored Jul 20, 2025
  
  83c104b1
- Add get_hidden_dim to qwen3.py for correct lora (#7312) · 877e35d7
  Pavel Logachev authored Jul 20, 2025
  
  877e35d7
- Enable FlashInfer support encoder models and add head_dim padding workaround (#6230) · cbdfb771
  Clay authored Jul 20, 2025
  
  cbdfb771
19 Jul, 2025 3 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Fix LoRA buffer contamination during adapter eviction (#8103) · 3de617a7
  Lifu Huang authored Jul 19, 2025
  
  3de617a7
- Clean up server args (#8161) · bb0e8a32
  Lianmin Zheng authored Jul 19, 2025
  
  bb0e8a32
14 Jul, 2025 2 commits
- Support for Phi-1.5 & Phi-2 models (#7862) · cb736df8
  Praneth Paruchuri authored Jul 14, 2025
  
  cb736df8
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
10 Jul, 2025 1 commit
- Feat: Support Phi-3.5-MoE in SGLang (#7907) · 2d54d4bb
  Binyao Jiang authored Jul 09, 2025
  
  2d54d4bb
05 Jul, 2025 1 commit
- Fix CI test OOM issue. (#7799) · 01f98730
  Lifu Huang authored Jul 05, 2025
  
  01f98730
04 Jul, 2025 1 commit
- Add V2-lite model test (#7390) · 4de03953
  YanbingJiang authored Jul 04, 2025
```
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  4de03953
02 Jul, 2025 1 commit
- Improve error handling for requests with unloaded LoRA path(s) (#7642) · 1a08358a
  Lifu Huang authored Jul 01, 2025
  
  1a08358a
28 Jun, 2025 2 commits
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
- Fix flakiness in LoRA batch test. (#7552) · 2373faa3
  Lifu Huang authored Jun 27, 2025
  
  2373faa3
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
10 Jun, 2025 1 commit
- Fix test_lora.py CI (#7061) · 3b014bc1
  Baizhou Zhang authored Jun 10, 2025
  
  3b014bc1
09 Jun, 2025 1 commit
- support qwen3 emebedding (#6990) · 451ffe74
  uylnap authored Jun 09, 2025
  
  451ffe74
04 Jun, 2025 1 commit
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475