Commits · 5994e6c373e9746ceedf215850093afd94f02ea4 · change / sglang · GitLab

26 Oct, 2025 4 commits
- Do not use `MagicMock` to mock `server_args` in tests (#12154) · 5994e6c3
  Liangsheng Yin authored Oct 26, 2025
  
  5994e6c3
- [quantization] AWQ Marlin doesn't work when dtype is bfloat16 (#11494) · 6371f7af
  Kai-Hsun Chen authored Oct 26, 2025
```
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  6371f7af
- [misc] depdencies & enviroment flag (#12113) · 8491c794
  Liangsheng Yin authored Oct 26, 2025
  
  8491c794
- [Test] Add dsv3.2 nsa backend testing (#11936) · b72f9f08
  Johnsonms authored Oct 25, 2025
  
  b72f9f08
25 Oct, 2025 6 commits
- Accelerate deepseek fp4 b200 ci (#11993) · d98b81e2
  Qiaolin Yu authored Oct 25, 2025
  
  d98b81e2
- Reenable b200 tests (#11814) · 9e656dd3
  Kangyan-Zhou authored Oct 25, 2025
  
  9e656dd3
- Skip TestLlama4LoRA in CI (#12098) · d9b31011
  Lifu Huang authored Oct 25, 2025
  
  d9b31011
- [Fix] Set global args in cpu test (#12105) · ce869793
  Baizhou Zhang authored Oct 24, 2025
  
  ce869793
- Support true on-policy (#12058) · 20bd2271
  fzyzcjy authored Oct 25, 2025
  
  20bd2271
- [2/N]Support DeepSeek-R1 w4a8 low latency deepep (#8464) · 13bf565d
  Jinwu authored Oct 25, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangchuan Huang <2510421000@qq.com>
```
  13bf565d
24 Oct, 2025 4 commits
- adjust dynamic vs static outputs comparison in test_lora_update.py (#11884) · fc86b18b
  Glen Liu authored Oct 24, 2025
  
  fc86b18b
- support more model in piecewise cuda graph (#11745) · 1801cd19
  narutolhy authored Oct 23, 2025
  
  1801cd19
- Refactor Triton-kernel MoE runner integration (#11795) · 62eff37b
  Jonah Bernard authored Oct 23, 2025
  
  62eff37b
- [8/n] decouple quantization impl from vllm dependency - gguf srt (#11964) · 14a4d80e
  Fan Yin authored Oct 24, 2025
```
Co-authored-by: Peng Zhang <zhuangsen.zp@antgroup.com>
```
  14a4d80e
23 Oct, 2025 9 commits
- Revert "[ROCm] Remove vLLM rope dependency & use AITER impl" (#12028) · 8ae9d4bb
  b8zhong authored Oct 23, 2025
  
  8ae9d4bb
- model: support deepseek-ocr (#11891) · 770529a7
  Mick authored Oct 24, 2025
```
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  770529a7
- ci: fix night-ci with push retry mechanism (#11765) · 8bd26dd4
  Mick authored Oct 24, 2025
  
  8bd26dd4
- Feature/nano v2 offline modelopt fp8 and nvfp4 (#12018) · a9849683
  Netanel Haber authored Oct 23, 2025
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  a9849683
- [Fix] memory leak by overlap + retract (#11981) · b0b4f716
  cctry authored Oct 23, 2025
```
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
```
  b0b4f716
- Revert "Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4" (#12015) · 6c18addb
  Liangsheng Yin authored Oct 23, 2025
  
  6c18addb
- Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4 (#11866) · d6fee73d
  Netanel Haber authored Oct 23, 2025
  
  d6fee73d
- [CPU] Optimize FP16 decode_attention_cpu (#10652) · 13fb8b54
  blzheng authored Oct 23, 2025
  
  13fb8b54
- [ROCm] Remove vLLM rope dependency & use AITER impl (#11322) · 4d4feccb
  b8zhong authored Oct 22, 2025
  
  4d4feccb
22 Oct, 2025 3 commits
- Fix flaky hicache test with mooncake backend (#11953) · 7fceeef5
  Shangming Cai authored Oct 22, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  7fceeef5
- [2/N] Added the core structure of elastic EP and the eplb algorithm with faulty rank (#10606) · 904655c5
  Hank Han authored Oct 22, 2025
```
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  904655c5
- Enable native ModelOpt quantization support (3/3) (#10154) · 80b2b320
  Zhiyu authored Oct 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  80b2b320
21 Oct, 2025 6 commits
- vlm: enforce pybase64 for image and str encode/decode (#10700) · d0a64c7e
  b8zhong authored Oct 21, 2025
  
  d0a64c7e
- [CI] disable glm4.1v and fix the flashinfer installation (#11902) · 05d3667a
  Shangming Cai authored Oct 21, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  05d3667a
- Support Thinking Budget (via custom_logit_processor for OpenAI API) [Fix #6572] (#11416) · dbb16bed
  ybyang authored Oct 21, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: YorkSu <york_su@qq.com>
```
  dbb16bed
- [FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570) · 852c0578
  Neelabh Sinha authored Oct 21, 2025
  
  852c0578
- Init attention backend for Intel XPU (#10656) · b113c72e
  Meng, Hengyu authored Oct 21, 2025
```
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  b113c72e
- piecewise cuda graph support qwen3-moe (#11845) · 8374a96e
  Xiaoyu Zhang authored Oct 21, 2025
  
  8374a96e
20 Oct, 2025 5 commits
- [Feature] New structural tag support (#10691) · 276e7b3e
  DarkSharpness authored Oct 20, 2025
  
  276e7b3e
- [Model] Add Olmo 3 model support (#11396) · d383e661
  Shane A authored Oct 19, 2025
  
  d383e661
- Support mrope triton kernel and add unit test (#11722) · 271d3d0d
  Yuan Luo authored Oct 20, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  271d3d0d
- [NVIDIA] FA3/FA4 Fix (#11606) · 252dc4e1
  Johnny authored Oct 20, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  252dc4e1
- [CI] Add CI test for DeepSeek V3.2 MTP (#11835) · cbb5fc2e
  Baizhou Zhang authored Oct 19, 2025
  
  cbb5fc2e
19 Oct, 2025 3 commits
- [logprobs] Enable local deterministic logrprobs testing with strict threshold (#10994) · 53fb229f
  Night authored Oct 19, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  53fb229f
- Deterministic Mode: Add 1-stage triton kernel for prefill (#11147) · 4fff1ec1
  Stefan He authored Oct 19, 2025
```
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>
```
  4fff1ec1
- [Test] Add basic matched stop for beta eagle (#11833) · 7a020e0f
  Liangsheng Yin authored Oct 20, 2025
  
  7a020e0f