Commits · a20e7df8d0bcccb37b02ce83919f73108bb407a2 · change / sglang

13 Oct, 2025 2 commits
- Improve dp attention port assignment scheme (#5889) · a20e7df8
  Yongtong Wu authored Oct 13, 2025
```
Co-authored-by: Cheng Wan <cwan@x.ai>
```
  a20e7df8
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 8 commits
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
- [CI] fix lint (#11509) · 2157d12a
  Liangsheng Yin authored Oct 13, 2025
  
  2157d12a
- doc: add doc for adding new models into nightly-ci (#11443) · 9f2b457c
  Mick authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  9f2b457c
- Fix unit tests (#11503) · 5a6ec8f9
  Lianmin Zheng authored Oct 12, 2025
  
  5a6ec8f9
- Fix port conflicts in CI (#11497) · 548a57b1
  Lianmin Zheng authored Oct 12, 2025
  
  548a57b1
- Piecewise CUDA Graph Support & Torch Compile Backend (#10062) · 4ac8e09d
  Yuwei An authored Oct 11, 2025
```
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
```
  4ac8e09d
- Beta spec-overlap for EAGLE (#11398) · 20a6c0a6
  Liangsheng Yin authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  20a6c0a6
- [Feature] support regex strings as a stopping condition (#10635) · 47c606d3
  Glen Liu authored Oct 11, 2025
  
  47c606d3
11 Oct, 2025 4 commits
- [DPSKv3.2] Rewrite nsa tilelang act_quant kernel to triton (#11450) · 451d15c4
  Binyao Jiang authored Oct 10, 2025
  
  451d15c4
- Fix batch invariant ops (#11368) · eae9a9fb
  Stefan He authored Oct 10, 2025
  
  eae9a9fb
- Reorder PD disagg CI tests (#11438) · 61055cb3
  Lianmin Zheng authored Oct 10, 2025
  
  61055cb3
- Separate allocation logic from scheduler (#11313) · b36afed4
  cctry authored Oct 10, 2025
  
  b36afed4
10 Oct, 2025 5 commits
- Revert "fix: fix video input for qwen3-vl" (#11437) · b4408e60
  Lianmin Zheng authored Oct 10, 2025
  
  b4408e60
- fix: fix video input for qwen3-vl (#11361) · a1a20b4c
  Mick authored Oct 10, 2025
  
  a1a20b4c
- feat(hicache): Support passing prefix keys for l3 store. (#9045) · ee3bd8a1
  hzh0425 authored Oct 10, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  ee3bd8a1
- [CI] Refactor PD disaggregation test suite (#11363) · 70fbb3ad
  Shangming Cai authored Oct 10, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  70fbb3ad
- [Bug Fix] prevent lora adapter from being loaded into LoRAManager if it is already loaded (#11365) · 9a7e7a65
  Glen Liu authored Oct 09, 2025
  
  9a7e7a65
09 Oct, 2025 1 commit
- [Generative Score API] Multi-Item scoring with custom attention mask. (#10979) · 53bd00d9
  Sundara Raman Ramachandran authored Oct 08, 2025
  
  53bd00d9
08 Oct, 2025 7 commits
- model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) · d6837aea
  Netanel Haber authored Oct 08, 2025
```
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
```
  d6837aea
- [CI] improve disaggregation CI. (#11264) · c882b5ae
  Liangsheng Yin authored Oct 08, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  c882b5ae
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
- [Feature] Add /tokenize and /detokenize OpenAI compatible endpoints (#9545) · 7c3f07db
  Adarsh Shirawalmath authored Oct 08, 2025
  
  7c3f07db
- ci: unify the model launch method of nightly ci (#11230) · 64d1505c
  Mick authored Oct 08, 2025
  
  64d1505c
- Clean match_prefix and prepare_for_extend for mem cache V2 (#11200) · f3764c26
  cctry authored Oct 07, 2025
  
  f3764c26
- [oai serving chat] Add argument `--sampling-defaults` and fix... · 7ba3de0e
  Chang Su authored Oct 07, 2025
```
[oai serving chat] Add argument `--sampling-defaults` and fix `ChatCompletionRequest` defaults (#11304)
```
  7ba3de0e
07 Oct, 2025 3 commits

EAGLE cache fix for SWARadixCache (#11231) · 24bc3fb0
Ke Bao authored Oct 07, 2025
```
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
24bc3fb0

Liangsheng Yin authored Oct 07, 2025


Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8a8a608a

convert test_deterministic into unit tests (#11095) · 9b4c4497

Alex Chi Z authored Oct 07, 2025


Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

9b4c4497

06 Oct, 2025 3 commits
- reverse the amd ci test back to 1200s and split the 8-gpu deepseek job into two. (#11238) · a57f0e3d
  sunxxuns authored Oct 06, 2025
```
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
```
  a57f0e3d
- Enable native ModelOpt quantization support (1/3) (#7149) · 155cbb51
  Zhiyu authored Oct 06, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  155cbb51
- Rename runner labels (#11228) · d645ae90
  Lianmin Zheng authored Oct 05, 2025
  
  d645ae90
05 Oct, 2025 4 commits
- Update transformers package version to 4.57.0 (#11222) · 652c24a6
  Xinyuan Tong authored Oct 05, 2025
```
Co-authored-by: yhyang201 <yhyang201@gmail.com>
```
  652c24a6
- [Fix AMD CI] VRAM cleanup (#11174) · 5e142484
  sunxxuns authored Oct 05, 2025
```
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
```
  5e142484
- Refactor and optimize mooncake CI (#11162) · c560410d
  Shangming Cai authored Oct 06, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  c560410d
- Update `v1/responses` to be more OpenAI-compatible. (#9624) · 36a6b8db
  Vincent Zhong authored Oct 05, 2025
  
  36a6b8db
04 Oct, 2025 3 commits
- EAGLE cache fix for HiCache (#11215) · 31b49c0b
  Ke Bao authored Oct 05, 2025
  
  31b49c0b
- [fix]enable flashmla when using draft model P/D attention select (#11012) · 666da3d5
  Hank Han authored Oct 04, 2025
  
  666da3d5
- [HICache]: Refactor HiCache CI (#11011) · c70e58e8
  hzh0425 authored Oct 04, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  c70e58e8