Commits · 271d3d0d50d324e4cfffa32a6ba3b3759124c30d · change / sglang

"vscode:/vscode.git/clone" did not exist on "c4a17027be9060e97b7ab056a9fb00679038bf64"

20 Oct, 2025 15 commits
- Support mrope triton kernel and add unit test (#11722) · 271d3d0d
  Yuan Luo authored Oct 20, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  271d3d0d
- [Feature] Use current greenctx stream to communicate in PD-Multiplexing. (#11594) · c4e81e64
  ykcombat authored Oct 20, 2025
  
  c4e81e64
- Recapture cuda graph after model weight update to resolve IMA error (#11780) · c726d44c
  harrisonlimh authored Oct 19, 2025
  
  c726d44c
- chore: bump sgl-kernel version to 0.3.16.post3 (#11733) · 283c8ba0
  sglang-bot authored Oct 19, 2025
  
  283c8ba0
- check master server for mooncake store (#10510) · cae39565
  huangtingwei authored Oct 20, 2025
  
  cae39565
- Improve Kernel Build Time (#11508) · 27a223ab
  Kangyan-Zhou authored Oct 19, 2025
  
  27a223ab
- Fix version bump script to handle TOML files with outdated versions (#11787) · 53529f46
  Kangyan-Zhou authored Oct 19, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  53529f46
- fix(ci): Fix CI Monitor limit parameter and add CI Analysis to summary (#11832) · 24ed3f32
  Xiaoyu Zhang authored Oct 20, 2025
  
  24ed3f32
- [Doc] Update documents for FA4 (#11778) · 44f0ece9
  Baizhou Zhang authored Oct 19, 2025
  
  44f0ece9
- [BugFix] replace the input_to_float8 used in dsv2 (#11612) · be0058bc
  Liu-congo authored Oct 20, 2025
```
Signed-off-by: Liu-congo <1502632128@qq.com>
```
  be0058bc
- Tiny bump DeepEP version in ARM blackwell (#11810) · 9e3be1fa
  fzyzcjy authored Oct 20, 2025
  
  9e3be1fa
- Fix triton_kernels import error on some hardwares (#11831) · a8ba3279
  fzyzcjy authored Oct 20, 2025
  
  a8ba3279
- [DeepseekV32] Add fast_topk_transform_ragged_fused kernel (#11815) · 3b80232d
  hlu1 authored Oct 19, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  3b80232d
- [NVIDIA] FA3/FA4 Fix (#11606) · 252dc4e1
  Johnny authored Oct 20, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  252dc4e1
- [CI] Add CI test for DeepSeek V3.2 MTP (#11835) · cbb5fc2e
  Baizhou Zhang authored Oct 19, 2025
  
  cbb5fc2e
19 Oct, 2025 21 commits
- [logprobs] Enable local deterministic logrprobs testing with strict threshold (#10994) · 53fb229f
  Night authored Oct 19, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  53fb229f
- Deterministic Mode: Add 1-stage triton kernel for prefill (#11147) · 4fff1ec1
  Stefan He authored Oct 19, 2025
```
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>
```
  4fff1ec1
- [Test] Add basic matched stop for beta eagle (#11833) · 7a020e0f
  Liangsheng Yin authored Oct 20, 2025
  
  7a020e0f
- [CI] always print back trace in `retry()` (#11834) · 48738af7
  Liangsheng Yin authored Oct 20, 2025
  
  48738af7
- [Spec Decoding] Support MTP for dsv3.2 (#11652) · efa47334
  Paiiii authored Oct 19, 2025
```
Co-authored-by: Paiiiiiiiiiiiiii <zengpai@baidu.com>
```
  efa47334
- [overlap-spec] fix stop condition and trimming (#11819) · d658f049
  Liangsheng Yin authored Oct 19, 2025
  
  d658f049
- Revert "Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds... · 57e25de7
  Liangsheng Yin authored Oct 19, 2025
```
Revert "Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in EAGLE + Long-Sequence Workloads" (#11827)
```
  57e25de7
- Change bf16 to fp8 for some gemms in attention for DeepSeek ckpt v2 (#11805) · 12eb02e9
  fzyzcjy authored Oct 19, 2025
  
  12eb02e9
- Avoid generation gets hanging when user specifies multiple event loops (#5162) · 002d0373
  fzyzcjy authored Oct 19, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  002d0373
- Support not officially supported high sgl-kernel version with low srt version (#11786) · a27825ae
  fzyzcjy authored Oct 19, 2025
  
  a27825ae
- Make single-batch overlap compatible with NextN (#11804) · ce399e15
  fzyzcjy authored Oct 19, 2025
  
  ce399e15
- Tiny add hints when users send requests to wrong place (#11808) · ea6275df
  fzyzcjy authored Oct 19, 2025
  
  ea6275df
- support tokenized batch request (#11091) · eb7318f1
  narutolhy authored Oct 19, 2025
  
  eb7318f1
- Update CODEOWNERS for layer quantization path (#11818) · 6058fb52
  Lianmin Zheng authored Oct 18, 2025
  
  6058fb52
- Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in... · 80407b04
  YAMY authored Oct 18, 2025
```
Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in EAGLE + Long-Sequence Workloads (#10788)
```
  80407b04
- Improve `send_sone` script (#11817) · b288f4f4
  Liangsheng Yin authored Oct 19, 2025
  
  b288f4f4
- fix: do not wrap invalid grammar objects during constrained generation (#11328) · 6d6ea5af
  tazjin authored Oct 19, 2025
  
  6d6ea5af
- make sure logit bias is applied during eagle spec decoding verification (#11555) · 1dacedd2
  Marin authored Oct 19, 2025
  
  1dacedd2
- [1/2][feature] support openai like classification api (#11618) · b5e14b2b
  ybyang authored Oct 19, 2025
  
  b5e14b2b
- [2/2] [feature] support openai like classification api in router (#11670) · d513ee93
  ybyang authored Oct 19, 2025
  
  d513ee93
- [router] Add Configurable L0 and L1 Tokenizer Caching (#11688) · a7ae61ed
  Simo Lin authored Oct 18, 2025
  
  a7ae61ed
18 Oct, 2025 4 commits
- Fix Dockerfile not installing correct version of DeepEP for arm build (#11773) · fda0cb2a
  kyleliang-nv authored Oct 18, 2025
  
  fda0cb2a
- Use cutlass fp4 gemm by default (#11813) · ebda73dc
  Qiaolin Yu authored Oct 18, 2025
  
  ebda73dc
- ci: update `lmms-eval` to speed up multimodal CI (#11000) · f4f8a1b4
  b8zhong authored Oct 18, 2025
  
  f4f8a1b4
- feat(example/fastapi): support --startup-timeout using... · c44e985d
  Kindyaa authored Oct 19, 2025
```
feat(example/fastapi): support --startup-timeout using Qwen3-Next-80B-A3B-Instruct as example (#11710)
Co-authored-by: chenan01 <chenan01@cheche-MacBook-Pro.local>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  c44e985d