Commits · 13bf565d60f894acf6a496591c2f2fc0eecc4a98 · change / sglang

"include/ck/utility/multi_index.hpp" did not exist on "fcbb978828b308d8c367a3eeaebee485a61b548c"

25 Oct, 2025 1 commit

[2/N]Support DeepSeek-R1 w4a8 low latency deepep (#8464) · 13bf565d

Jinwu authored Oct 25, 2025


Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangchuan Huang <2510421000@qq.com>

13bf565d

24 Oct, 2025 4 commits
- adjust dynamic vs static outputs comparison in test_lora_update.py (#11884) · fc86b18b
  Glen Liu authored Oct 24, 2025
  
  fc86b18b
- support more model in piecewise cuda graph (#11745) · 1801cd19
  narutolhy authored Oct 23, 2025
  
  1801cd19
- Refactor Triton-kernel MoE runner integration (#11795) · 62eff37b
  Jonah Bernard authored Oct 23, 2025
  
  62eff37b
- [8/n] decouple quantization impl from vllm dependency - gguf srt (#11964) · 14a4d80e
  Fan Yin authored Oct 24, 2025
```
Co-authored-by: Peng Zhang <zhuangsen.zp@antgroup.com>
```
  14a4d80e
23 Oct, 2025 9 commits
- Revert "[ROCm] Remove vLLM rope dependency & use AITER impl" (#12028) · 8ae9d4bb
  b8zhong authored Oct 23, 2025
  
  8ae9d4bb
- model: support deepseek-ocr (#11891) · 770529a7
  Mick authored Oct 24, 2025
```
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  770529a7
- ci: fix night-ci with push retry mechanism (#11765) · 8bd26dd4
  Mick authored Oct 24, 2025
  
  8bd26dd4
- Feature/nano v2 offline modelopt fp8 and nvfp4 (#12018) · a9849683
  Netanel Haber authored Oct 23, 2025
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  a9849683
- [Fix] memory leak by overlap + retract (#11981) · b0b4f716
  cctry authored Oct 23, 2025
```
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
```
  b0b4f716
- Revert "Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4" (#12015) · 6c18addb
  Liangsheng Yin authored Oct 23, 2025
  
  6c18addb
- Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4 (#11866) · d6fee73d
  Netanel Haber authored Oct 23, 2025
  
  d6fee73d
- [CPU] Optimize FP16 decode_attention_cpu (#10652) · 13fb8b54
  blzheng authored Oct 23, 2025
  
  13fb8b54
- [ROCm] Remove vLLM rope dependency & use AITER impl (#11322) · 4d4feccb
  b8zhong authored Oct 22, 2025
  
  4d4feccb
22 Oct, 2025 3 commits
- Fix flaky hicache test with mooncake backend (#11953) · 7fceeef5
  Shangming Cai authored Oct 22, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  7fceeef5
- [2/N] Added the core structure of elastic EP and the eplb algorithm with faulty rank (#10606) · 904655c5
  Hank Han authored Oct 22, 2025
```
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  904655c5
- Enable native ModelOpt quantization support (3/3) (#10154) · 80b2b320
  Zhiyu authored Oct 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  80b2b320
21 Oct, 2025 6 commits
- vlm: enforce pybase64 for image and str encode/decode (#10700) · d0a64c7e
  b8zhong authored Oct 21, 2025
  
  d0a64c7e
- [CI] disable glm4.1v and fix the flashinfer installation (#11902) · 05d3667a
  Shangming Cai authored Oct 21, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  05d3667a
- Support Thinking Budget (via custom_logit_processor for OpenAI API) [Fix #6572] (#11416) · dbb16bed
  ybyang authored Oct 21, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: YorkSu <york_su@qq.com>
```
  dbb16bed
- [FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570) · 852c0578
  Neelabh Sinha authored Oct 21, 2025
  
  852c0578
- Init attention backend for Intel XPU (#10656) · b113c72e
  Meng, Hengyu authored Oct 21, 2025
```
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  b113c72e
- piecewise cuda graph support qwen3-moe (#11845) · 8374a96e
  Xiaoyu Zhang authored Oct 21, 2025
  
  8374a96e
20 Oct, 2025 5 commits
- [Feature] New structural tag support (#10691) · 276e7b3e
  DarkSharpness authored Oct 20, 2025
  
  276e7b3e
- [Model] Add Olmo 3 model support (#11396) · d383e661
  Shane A authored Oct 19, 2025
  
  d383e661
- Support mrope triton kernel and add unit test (#11722) · 271d3d0d
  Yuan Luo authored Oct 20, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  271d3d0d
- [NVIDIA] FA3/FA4 Fix (#11606) · 252dc4e1
  Johnny authored Oct 20, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  252dc4e1
- [CI] Add CI test for DeepSeek V3.2 MTP (#11835) · cbb5fc2e
  Baizhou Zhang authored Oct 19, 2025
  
  cbb5fc2e
19 Oct, 2025 3 commits
- [logprobs] Enable local deterministic logrprobs testing with strict threshold (#10994) · 53fb229f
  Night authored Oct 19, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  53fb229f
- Deterministic Mode: Add 1-stage triton kernel for prefill (#11147) · 4fff1ec1
  Stefan He authored Oct 19, 2025
```
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>
```
  4fff1ec1
- [Test] Add basic matched stop for beta eagle (#11833) · 7a020e0f
  Liangsheng Yin authored Oct 20, 2025
  
  7a020e0f
18 Oct, 2025 2 commits
- ci: update `lmms-eval` to speed up multimodal CI (#11000) · f4f8a1b4
  b8zhong authored Oct 18, 2025
  
  f4f8a1b4
- completely remove mixed mode deterministic test as prefix mode could cover it (#11783) · 13219e1e
  Minglei Zhu authored Oct 17, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  13219e1e
17 Oct, 2025 4 commits
- [minor] sync code on python/sglang/test/test_deterministic.py and improve ci tests (#11777) · b9a54e09
  Lianmin Zheng authored Oct 17, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  b9a54e09
- Turn on shm_allreduce and shm_allgather for fp16 (#10725) · 8fcc69e7
  Chunyuan WU authored Oct 18, 2025
  
  8fcc69e7
- Revert "Set csgmv as default lora backend. (#11488)" (#11735) · da681f35
  Yineng Zhang authored Oct 17, 2025
  
  da681f35
- ci: reduce and refactor vlm ut and combine test files (#11062) · 3e4c7da2
  Mick authored Oct 17, 2025
  
  3e4c7da2
16 Oct, 2025 3 commits
- model: qwen3-omni (thinker-only) (#10911) · 86b04d25
  Mick authored Oct 17, 2025
```
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  86b04d25
- [ci]use H20 to run disaggregation test (#11543) · 0dd6cf16
  Hank Han authored Oct 17, 2025
  
  0dd6cf16
- [CI] Add GLM4MoE model test (#11706) · 1de3924b
  Shangming Cai authored Oct 16, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  1de3924b