Commits · 70fbb3adf65a1058ca31cf1ce916d99ea4835dfa · change / sglang

10 Oct, 2025 2 commits
- [CI] Refactor PD disaggregation test suite (#11363) · 70fbb3ad
  Shangming Cai authored Oct 10, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  70fbb3ad
- [Bug Fix] prevent lora adapter from being loaded into LoRAManager if it is already loaded (#11365) · 9a7e7a65
  Glen Liu authored Oct 09, 2025
  
  9a7e7a65
09 Oct, 2025 1 commit
- [Generative Score API] Multi-Item scoring with custom attention mask. (#10979) · 53bd00d9
  Sundara Raman Ramachandran authored Oct 08, 2025
  
  53bd00d9
08 Oct, 2025 7 commits
- model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) · d6837aea
  Netanel Haber authored Oct 08, 2025
```
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
```
  d6837aea
- [CI] improve disaggregation CI. (#11264) · c882b5ae
  Liangsheng Yin authored Oct 08, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  c882b5ae
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
- [Feature] Add /tokenize and /detokenize OpenAI compatible endpoints (#9545) · 7c3f07db
  Adarsh Shirawalmath authored Oct 08, 2025
  
  7c3f07db
- ci: unify the model launch method of nightly ci (#11230) · 64d1505c
  Mick authored Oct 08, 2025
  
  64d1505c
- Clean match_prefix and prepare_for_extend for mem cache V2 (#11200) · f3764c26
  cctry authored Oct 07, 2025
  
  f3764c26
- [oai serving chat] Add argument `--sampling-defaults` and fix... · 7ba3de0e
  Chang Su authored Oct 07, 2025
```
[oai serving chat] Add argument `--sampling-defaults` and fix `ChatCompletionRequest` defaults (#11304)
```
  7ba3de0e
07 Oct, 2025 3 commits

EAGLE cache fix for SWARadixCache (#11231) · 24bc3fb0
Ke Bao authored Oct 07, 2025
```
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
24bc3fb0

Liangsheng Yin authored Oct 07, 2025


Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8a8a608a

convert test_deterministic into unit tests (#11095) · 9b4c4497

Alex Chi Z authored Oct 07, 2025


Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

9b4c4497

06 Oct, 2025 3 commits
- reverse the amd ci test back to 1200s and split the 8-gpu deepseek job into two. (#11238) · a57f0e3d
  sunxxuns authored Oct 06, 2025
```
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
```
  a57f0e3d
- Enable native ModelOpt quantization support (1/3) (#7149) · 155cbb51
  Zhiyu authored Oct 06, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  155cbb51
- Rename runner labels (#11228) · d645ae90
  Lianmin Zheng authored Oct 05, 2025
  
  d645ae90
05 Oct, 2025 4 commits
- Update transformers package version to 4.57.0 (#11222) · 652c24a6
  Xinyuan Tong authored Oct 05, 2025
```
Co-authored-by: yhyang201 <yhyang201@gmail.com>
```
  652c24a6
- [Fix AMD CI] VRAM cleanup (#11174) · 5e142484
  sunxxuns authored Oct 05, 2025
```
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
```
  5e142484
- Refactor and optimize mooncake CI (#11162) · c560410d
  Shangming Cai authored Oct 06, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  c560410d
- Update `v1/responses` to be more OpenAI-compatible. (#9624) · 36a6b8db
  Vincent Zhong authored Oct 05, 2025
  
  36a6b8db
04 Oct, 2025 3 commits
- EAGLE cache fix for HiCache (#11215) · 31b49c0b
  Ke Bao authored Oct 05, 2025
  
  31b49c0b
- [fix]enable flashmla when using draft model P/D attention select (#11012) · 666da3d5
  Hank Han authored Oct 04, 2025
  
  666da3d5
- [HICache]: Refactor HiCache CI (#11011) · c70e58e8
  hzh0425 authored Oct 04, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  c70e58e8
03 Oct, 2025 7 commits
- [minor] fix the lint (#11198) · 4726c919
  Liangsheng Yin authored Oct 04, 2025
  
  4726c919
- [Test] Initialize mem_fraction_static in setUpClass to fix pytest VLM test crashes. (#10859) · 586e81a2
  vikram singh shekhawat authored Oct 03, 2025
```
Co-authored-by: svc_repro_tool <svc_repro_tool@habana.ai>
```
  586e81a2
- Fix [test]: Env:SGLANG_TORCH_PROFILER_DIR for pytest. (#10780) · 03def5e3
  shubham singhal authored Oct 03, 2025
  
  03def5e3
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
- Tiny add PD disaggregation + DP attention test (#11167) · 6794d210
  fzyzcjy authored Oct 03, 2025
  
  6794d210
- [Generative Scores API] add performance tests to CICD (#10830) · 7e61737d
  Vedant V Jhaveri authored Oct 02, 2025
  
  7e61737d
02 Oct, 2025 3 commits
- Remove dp balance metadata and minimul token balance. (#11170) · 7ff740a6
  Liangsheng Yin authored Oct 03, 2025
  
  7ff740a6
- [model] Add mamba2 and Falcon-H1 support. (#10988) · 083629c2
  ilyasch2 authored Oct 02, 2025
```
Co-authored-by: Younes Belkada <younes.belkada@tii.ae>
Co-authored-by: Younes B <49240599+younesbelkada@users.noreply.github.com>
```
  083629c2
- Fix ngram spec with page size > 1 (#11135) · 25e7dbe8
  Liangsheng Yin authored Oct 02, 2025
  
  25e7dbe8
01 Oct, 2025 2 commits
- Refactor AMD CI. (#11128) · 195a59fe
  Sai Enduri authored Oct 01, 2025
  
  195a59fe
- Organize spec-related data structures (#10735) · 73d4a5f8
  Liangsheng Yin authored Oct 01, 2025
  
  73d4a5f8
30 Sep, 2025 2 commits
- Fix eagle radix cache (#10846) · 91847e38
  Ke Bao authored Sep 30, 2025
  
  91847e38
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
29 Sep, 2025 3 commits
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f
- Use more general heuristics to set the default value of --mem-fraction-static (#10975) · a17e70f5
  Lianmin Zheng authored Sep 29, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  a17e70f5
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e