Commits · 0e5fa67773535d8916cf436fc3d1f689d7195b2f · zhaoyu6 / sglang

"vscode:/vscode.git/clone" did not exist on "cadd5dbe6a6ab389ca5df06d094f202498b2f535"

24 Jul, 2025 3 commits
- [AMD] Pull latest image for AMD CI (#8070) · 0e5fa677
  michael-amd authored Jul 23, 2025
  
  0e5fa677
- Fix incomplete tool call capture issue in streaming response of DeepSeek-V3... · 624a3b8d
  xianzhiT authored Jul 24, 2025
```
Fix incomplete tool call capture issue in streaming response of DeepSeek-V3 when enable MTP  (#7562)
```
  624a3b8d
- feat(function call): complete utility method for KimiK2Detector and enhance documentation (#8043) · 01079e17
  Chang Su authored Jul 23, 2025
  
  01079e17
23 Jul, 2025 15 commits
- fix: prevent crashes due to logit bias dimension mismatch (#7685) · 0e7a5b26
  J authored Jul 23, 2025
  
  0e7a5b26
- chore: upgrade sgl-kernel 0.2.7 (#8304) · 4953f4ca
  Yineng Zhang authored Jul 23, 2025
  
  4953f4ca
- Fix gemma3n with hybrid swa (#8240) · 38000a5f
  Xinyuan Tong authored Jul 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  38000a5f
- fix: match chat-template for internvl3 (#8262) · 70251e93
  Xinyuan Tong authored Jul 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  70251e93
- Fix the issue of incorrect finish reason in final stream response chunk... · c87d4fec
  xianzhiT authored Jul 24, 2025
```
Fix the issue of incorrect finish reason in final stream response chunk returned during tool call (#7708)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  c87d4fec
- [Performance][PD Disaggregation] optimize TokenToKVPoolAllocator by sorting free pages (#8133) · a99801e0
  YiXR authored Jul 24, 2025
```
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
Co-authored-by: Xingrui Yi <yixingrui@linux.alibaba.com>
```
  a99801e0
- fix: workaround for deepgemm warmup issue (#8302) · 4c605235
  Yineng Zhang authored Jul 23, 2025
  
  4c605235
- [router] add common ut infra to mock worker and app (#8295) · 6f8f4aee
  Simo Lin authored Jul 23, 2025
  
  6f8f4aee
- [sgl-kernel] Opt per_token_quant_fp8 with warp reduce (#8130) · 0c8dab9e
  Yuan Luo authored Jul 23, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  0c8dab9e
- HiCache Fix (#8288) · f39037ff
  Zhiqiang Xie authored Jul 23, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
```
  f39037ff
- bug fix and tag (#8282) · ce86e201
  Zhiqiang Xie authored Jul 23, 2025
  
  ce86e201
- Hicache IO kernel refactoring (#8264) · b4326330
  Zhiqiang Xie authored Jul 23, 2025
  
  b4326330
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77
- Fix sgl-kernel ci test (#8284) · e885bfdc
  Ke Bao authored Jul 23, 2025
  
  e885bfdc
- Skip llama4 vision module loading when multimodal disabled (#8272) · e2d66f60
  Ke Bao authored Jul 23, 2025
```
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  e2d66f60
22 Jul, 2025 7 commits
- chore: bump v0.4.9.post3 (#8265) · 01c00004
  Yineng Zhang authored Jul 22, 2025
  
  01c00004
- Preliminary Support for Qwen3XMLDetector (#8260) · 0dfe2491
  yhyang201 authored Jul 23, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  0dfe2491
- [Benchmark] add disable-auto-run param for hicache/bench_multiturn (#7822) · ff45ab7a
  zhongwei authored Jul 23, 2025
```
Co-authored-by: zhongwei.ren <zhongwei.ren@bytedance.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  ff45ab7a
- [fix] benchmark : routed_scaling_factor is None (#8059) · 0f8b5386
  Peter Pan authored Jul 22, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  0f8b5386
- fix: sgl-router remove dead code (#8257) · c33499a6
  Rui Chen authored Jul 22, 2025
  
  c33499a6
- [AMD] Remove vllm's scaled_fp8_quant and moe_sum when SGLANG_USE_AITER=1 (#7484) · e50109f2
  Hubert Lu authored Jul 21, 2025
  
  e50109f2
- fix: retrieve mm token by modality, raise error if none (#8221) · 69adc4f8
  Xinyuan Tong authored Jul 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  69adc4f8
21 Jul, 2025 10 commits
- docs: update 2025 h2 roadmap (#8237) · 11483785
  Yineng Zhang authored Jul 21, 2025
  
  11483785
- [Feature] Add a test for Layer-wise Prefill (#8231) · 7b68d271
  Xiaoze Fan authored Jul 21, 2025
```
Signed-off-by: jason-fxz <jason341132@qq.com>
```
  7b68d271
- chore: upgrade sgl-kernel 0.2.6.post1 (#8202) · 74f59ae5
  Yineng Zhang authored Jul 21, 2025
  
  74f59ae5
- Remve router gemm output dtype conversion (#8204) · 6936be32
  Ke Bao authored Jul 21, 2025
  
  6936be32
- [router] upgade router version to 0.1.6 (#8209) · 9b5de6cb
  Simo Lin authored Jul 20, 2025
  
  9b5de6cb
- [router] add ut for pd router (#8208) · 5c8365a0
  Simo Lin authored Jul 20, 2025
  
  5c8365a0
- [Refactor] simplify multimodal data processing (#8107) · 8430bfe3
  Xinyuan Tong authored Jul 20, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  8430bfe3
- Apply fused sorted token ids padding (#8193) · c9e8613c
  Ke Bao authored Jul 21, 2025
  
  c9e8613c
- chore: bump sgl-kernel v0.2.6.post1 (#8200) · 429bb0ef
  Yineng Zhang authored Jul 20, 2025
  
  429bb0ef
- [fix] fix modelopt fp4 on b200 (#8195) · 7eebd440
  JieXin Liang authored Jul 21, 2025
  
  7eebd440
20 Jul, 2025 5 commits
- [feature] enable NPU CI (#7935) · 93d124ef
  ronnie_zheng authored Jul 20, 2025
```
Co-authored-by: Even Zhou <14368888+iforgetmyname@users.noreply.github.com>
```
  93d124ef
- [router] add ut for pd request, metrics and config (#8184) · 1fc455e8
  Simo Lin authored Jul 20, 2025
  
  1fc455e8
- Fix dtype error in CI (#8197) · 465968b2
  Ke Bao authored Jul 21, 2025
  
  465968b2
- fix: fix the bug of loading Internvl3 (#8067) · 750838ad
  GuoYipin authored Jul 20, 2025
```
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  750838ad
- Fix eagle3 cuda graph (#8163) · 99aefa03
  Jay Zhou authored Jul 20, 2025
  
  99aefa03