Commits · b0d20cdec79c9b4cc1a10ee9cc2ffa35451a9df1 · change / sglang · GitLab

16 Oct, 2025 5 commits
- Set csgmv as default lora backend. (#11488) · b0d20cde
  Lifu Huang authored Oct 15, 2025
  
  b0d20cde
- Split test_intel_amx_attention_backend.py to pass CI of timeout (#11370) · cbac4997
  YanbingJiang authored Oct 16, 2025
```
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
```
  cbac4997
- [PD] Add PD support for hybrid model (Qwen3-Next, DeepSeek V3.2 Exp) (#10912) · 868403f6
  Shangming Cai authored Oct 16, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: ZeldaHuang <hzm414167@alibaba-inc.com>
```
  868403f6
- Sync code and test CI; rename some env vars (#11686) · cd7e1bd5
  Lianmin Zheng authored Oct 15, 2025
  
  cd7e1bd5
- [CI][XPU]enable sglang CI on Intel XPU (#9493) · 4c03dbaa
  DiweiSun authored Oct 16, 2025
```
Co-authored-by: huaiyuzh <huaiyu.zheng@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  4c03dbaa
15 Oct, 2025 2 commits
- [1/N]Support DeepSeek-R1 w4a8 normal deepep (#8247) · 825432fc
  Jinwu authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
```
  825432fc
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
14 Oct, 2025 3 commits
- move eagle draft post process to cuda graph (#11434) · 56222658
  yinghui authored Oct 14, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  56222658
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
- [FEATURE] Add Profile Trace Merger for Distributed Traces (#11413) · aaf7af1b
  Neelabh Sinha authored Oct 13, 2025
  
  aaf7af1b
13 Oct, 2025 10 commits
- [CI] Add Basic Test for DeepSeek V3.2 (#11308) · 9f1f699a
  Baizhou Zhang authored Oct 13, 2025
  
  9f1f699a
- Move deep gemm related arguments to `sglang.srt.environ` (#11547) · acc2327b
  Liangsheng Yin authored Oct 14, 2025
  
  acc2327b
- fix: fix video input for qwen3-vl (#11442) · f35f120d
  Mick authored Oct 14, 2025
  
  f35f120d
- Depreate `global_server_args_dict` (#11528) · 516738b0
  Liangsheng Yin authored Oct 13, 2025
  
  516738b0
- Tiny fix test run estimated time (#11544) · c5fe3c0b
  Shangming Cai authored Oct 13, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  c5fe3c0b
- [HICache]: Support 3FS-Store with page_first_direct layout (#11460) · 318424e2
  hzh0425 authored Oct 13, 2025
  
  318424e2
- ci: improve nightly-ci (#11385) · 0c0779d6
  Mick authored Oct 13, 2025
  
  0c0779d6
- [Feature] Support mamba radix cache v0 (#11214) · a55cf530
  Yi Zhang authored Oct 13, 2025
```
Co-authored-by: hanming-lu <hanming@x.ai>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: thalahors <ericalcaide1@gmail.com>
```
  a55cf530
- Improve dp attention port assignment scheme (#5889) · a20e7df8
  Yongtong Wu authored Oct 13, 2025
```
Co-authored-by: Cheng Wan <cwan@x.ai>
```
  a20e7df8
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 8 commits
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
- [CI] fix lint (#11509) · 2157d12a
  Liangsheng Yin authored Oct 13, 2025
  
  2157d12a
- doc: add doc for adding new models into nightly-ci (#11443) · 9f2b457c
  Mick authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  9f2b457c
- Fix unit tests (#11503) · 5a6ec8f9
  Lianmin Zheng authored Oct 12, 2025
  
  5a6ec8f9
- Fix port conflicts in CI (#11497) · 548a57b1
  Lianmin Zheng authored Oct 12, 2025
  
  548a57b1
- Piecewise CUDA Graph Support & Torch Compile Backend (#10062) · 4ac8e09d
  Yuwei An authored Oct 11, 2025
```
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
```
  4ac8e09d
- Beta spec-overlap for EAGLE (#11398) · 20a6c0a6
  Liangsheng Yin authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  20a6c0a6
- [Feature] support regex strings as a stopping condition (#10635) · 47c606d3
  Glen Liu authored Oct 11, 2025
  
  47c606d3
11 Oct, 2025 4 commits
- [DPSKv3.2] Rewrite nsa tilelang act_quant kernel to triton (#11450) · 451d15c4
  Binyao Jiang authored Oct 10, 2025
  
  451d15c4
- Fix batch invariant ops (#11368) · eae9a9fb
  Stefan He authored Oct 10, 2025
  
  eae9a9fb
- Reorder PD disagg CI tests (#11438) · 61055cb3
  Lianmin Zheng authored Oct 10, 2025
  
  61055cb3
- Separate allocation logic from scheduler (#11313) · b36afed4
  cctry authored Oct 10, 2025
  
  b36afed4
10 Oct, 2025 5 commits
- Revert "fix: fix video input for qwen3-vl" (#11437) · b4408e60
  Lianmin Zheng authored Oct 10, 2025
  
  b4408e60
- fix: fix video input for qwen3-vl (#11361) · a1a20b4c
  Mick authored Oct 10, 2025
  
  a1a20b4c
- feat(hicache): Support passing prefix keys for l3 store. (#9045) · ee3bd8a1
  hzh0425 authored Oct 10, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  ee3bd8a1
- [CI] Refactor PD disaggregation test suite (#11363) · 70fbb3ad
  Shangming Cai authored Oct 10, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  70fbb3ad
- [Bug Fix] prevent lora adapter from being loaded into LoRAManager if it is already loaded (#11365) · 9a7e7a65
  Glen Liu authored Oct 09, 2025
  
  9a7e7a65
09 Oct, 2025 1 commit
- [Generative Score API] Multi-Item scoring with custom attention mask. (#10979) · 53bd00d9
  Sundara Raman Ramachandran authored Oct 08, 2025
  
  53bd00d9
08 Oct, 2025 2 commits
- model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) · d6837aea
  Netanel Haber authored Oct 08, 2025
```
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
```
  d6837aea
- [CI] improve disaggregation CI. (#11264) · c882b5ae
  Liangsheng Yin authored Oct 08, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  c882b5ae