Commits · 0ff72419959981a43bf491ba6761bc6bd8af2c06 · change / sglang · GitLab

26 Aug, 2025 2 commits
- Improve bench_one_batch_server script (#9608) · 0ff72419
  Liangsheng Yin authored Aug 26, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0ff72419
- [Fix] HiCache Bugfix & Mooncake Error Handling Enhance (#8901) · 80dc76e1
  ykwd authored Aug 26, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  80dc76e1
25 Aug, 2025 16 commits
- Fix Harmony reasoning parser for and auto-separation for gpt-oss models (#9190) · a0a77d93
  Jonas authored Aug 26, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: minleminzui <2969413251@qq.com>
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  a0a77d93
- Fix GLM45v launch server cuda torch compile bug (#9554) · 24a8cee6
  Binyao Jiang authored Aug 25, 2025
  
  24a8cee6
- Fix GLM45 tool call multi-turn bug (#9500) · 3affa9dc
  Binyao Jiang authored Aug 25, 2025
  
  3affa9dc
- [Performance] Batch Send from Tokenizer Manager. (#9436) · ea0696b9
  Sundara Raman Ramachandran authored Aug 25, 2025
  
  ea0696b9
- chore: bump v0.5.1.post2 (#9592) · e3e97a12
  Yineng Zhang authored Aug 25, 2025
  
  e3e97a12
- chore: update config (#9591) · 05106867
  Yineng Zhang authored Aug 25, 2025
  
  05106867
- Tiny fix wrong comments (#9589) · 9dcdf5da
  fzyzcjy authored Aug 25, 2025
  
  9dcdf5da
- fix: revert #8593 (#9581) · ebd9dbe7
  Yineng Zhang authored Aug 25, 2025
  
  ebd9dbe7
- chore: upgrade flashinfer 0.2.14.post1 (#9578) · 938e986e
  Yineng Zhang authored Aug 25, 2025
  
  938e986e
- bugfix for undefined logging functions in HarmonyBrowserTool & HarmonyPythonTool (#9229) · 17d5eda8
  Yuhao Zhou authored Aug 25, 2025
  
  17d5eda8
- Offload tensors by sharding on GPU (#9536) · 71a7f1d8
  fzyzcjy authored Aug 25, 2025
  
  71a7f1d8
- Reintroduce memory usage fix (#9535) · 433266c1
  fzyzcjy authored Aug 25, 2025
  
  433266c1
- Update CUTLASS 4.2 & Enable K-Major Scale Factor for SM90 FP8 Blockwise Group GEMM (#9559) · fda47926
  Qi Yuhang authored Aug 25, 2025
  
  fda47926
- remove redundant rank0_log function. (#9560) · a0b22f2f
  miter authored Aug 25, 2025
```
Co-authored-by: linhuang <linhuang@ruijie.com.cn>
```
  a0b22f2f
- [PD] Improve disaggregation metrics output: update the metrics to keep... · b5c6529e
  SCDESPERTATE authored Aug 25, 2025
```
[PD] Improve disaggregation metrics output: update the metrics to keep reflecting real stats (#7317)
```
  b5c6529e
- Add target module validation for init adapters (#9429) · dd6ec029
  Beichen Ma authored Aug 24, 2025
  
  dd6ec029
24 Aug, 2025 3 commits
- chore: bump v0.5.1.post1 (#9558) · e0ab167d
  Yineng Zhang authored Aug 24, 2025
  
  e0ab167d
- chore: update configurer (#9557) · c807cd7c
  Yineng Zhang authored Aug 24, 2025
  
  c807cd7c
- fix(grok): remove duplicate replicate_lm_head configuration (#9549) · 327f7b7c
  Vincent Zhong authored Aug 23, 2025
  
  327f7b7c
23 Aug, 2025 12 commits
- Release 0.5.1 (#9533) · 97a38ee8
  Lianmin Zheng authored Aug 23, 2025
  
  97a38ee8
- Update grok.py and tiktoken tokenizer (#9532) · 86d10d22
  Lianmin Zheng authored Aug 23, 2025
  
  86d10d22
- feat(hicache): Supports 3fs-hicache compatibility with dp-attention (#9372) · 83871aa1
  hzh0425 authored Aug 23, 2025
  
  83871aa1
- Partially unify triton per token group quant kernels (#9485) · b1b3f0b3
  fzyzcjy authored Aug 23, 2025
  
  b1b3f0b3
- Tiny make device_loading_context more static (#9478) · 34e5e11f
  fzyzcjy authored Aug 23, 2025
  
  34e5e11f
- Overlapped weight offload (#8034) · 2600fc0d
  fzyzcjy authored Aug 23, 2025
  
  2600fc0d
- [fix] Fix mxfp4 triton MoE tp bug (#9473) · ccd3fb94
  hlu1 authored Aug 23, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  ccd3fb94
- tool-call(dsv3): Improve deepseek-v3 chat template and tool_choice = `required` (#9525) · c9dd70fb
  Chang Su authored Aug 23, 2025
  
  c9dd70fb
- fix: blackwell dsv3 fp8 issue temporary solution (#9530) · 6b2b8bf0
  Yineng Zhang authored Aug 23, 2025
  
  6b2b8bf0
- Add enable_flashinfer_mxfp4_bf16_moe for higher precision and slower moe backend (#9004) · 0374304a
  fzyzcjy authored Aug 23, 2025
  
  0374304a
- Support GC Freezing to improve latency & throughput (#9241) · 127d4b0d
  Chanh Nguyen authored Aug 22, 2025
```
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  127d4b0d
- Add support for extensions of interface and pre-registrations to NIXL HiCache (#9211) · 7e880286
  Moein Khazraee authored Aug 22, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  7e880286
22 Aug, 2025 7 commits
- Add Qwen3-30B-A3B-Thinking-2507 support on AMD GPUs. (#9456) · c4500233
  sogalin authored Aug 22, 2025
  
  c4500233
- [AMD] Fix Llama 4 FP8 accuracy issues on MI300X (#7699) · f445a1d9
  Hubert Lu authored Aug 22, 2025
  
  f445a1d9
- [MTP] Force greedy sampling on AMD (#9127) · 110a6598
  datdo-msft authored Aug 22, 2025
  
  110a6598
- Use Tensor Core Decode when gqa group size >= 4 (#8624) · 0f587e80
  Wenxuan Tan authored Aug 22, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0f587e80
- [HiCacheStorage] backup optimization for MLA model (#8865) · 6078d5fc
  huangtingwei authored Aug 22, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  6078d5fc
- 3fs zerocopy (#9109) · 70cf4abc
  pansicheng authored Aug 22, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  70cf4abc
- [bugfix] Make --enable-hierarchical-cache and --disable-radix-cache mutually exclusive (#9452) · cebf4599
  Xuchun Shang authored Aug 22, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
```
  cebf4599