Commits · fdff3167c563cfaf9e33f483db4c9239a92f6e7d · change / sglang · GitLab

26 Aug, 2025 11 commits
- [docs] Update README with additional highlights and resources for SGLang x AMD SF Meetup (#9640) · fdff3167
  Mingyi authored Aug 26, 2025
  
  fdff3167
- Fix lint for router (#9636) · cbc0e4d7
  Stefan He authored Aug 26, 2025
  
  cbc0e4d7
- model: Support nvidia/Llama-3_1-Nemotron-Ultra-253B-v1 (#9301) · 4cd08dc5
  Netanel Haber authored Aug 26, 2025
  
  4cd08dc5
- [new feat] ascend backend support fia fusion kernel (#8328) · f92b729d
  ZhengdQin authored Aug 26, 2025
```
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
```
  f92b729d
- [router] add ut for mistral, llama, pythonic, and streaming tool parser (#9632) · e2e378ca
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  e2e378ca
- [router] add llama tool parser (#9629) · dc1decc6
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  dc1decc6
- [router] add pythonic parser (#9628) · 03680f33
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  03680f33
- [router] add qwen tool parser (#9623) · d4c5e534
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  d4c5e534
- [router] add mistral tool parser (#9622) · 817c62a0
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  817c62a0
- Improve bench_one_batch_server script (#9608) · 0ff72419
  Liangsheng Yin authored Aug 26, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0ff72419
- [Fix] HiCache Bugfix & Mooncake Error Handling Enhance (#8901) · 80dc76e1
  ykwd authored Aug 26, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  80dc76e1
25 Aug, 2025 20 commits
- [docs] Refactor, remove compiled results and add gpt-oss (#9613) · 9b08d975
  Chayenne authored Aug 25, 2025
```
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
```
  9b08d975
- Fix Harmony reasoning parser for and auto-separation for gpt-oss models (#9190) · a0a77d93
  Jonas authored Aug 26, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: minleminzui <2969413251@qq.com>
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  a0a77d93
- Fix GLM45v launch server cuda torch compile bug (#9554) · 24a8cee6
  Binyao Jiang authored Aug 25, 2025
  
  24a8cee6
- Fix GLM45 tool call multi-turn bug (#9500) · 3affa9dc
  Binyao Jiang authored Aug 25, 2025
  
  3affa9dc
- [Performance] Batch Send from Tokenizer Manager. (#9436) · ea0696b9
  Sundara Raman Ramachandran authored Aug 25, 2025
  
  ea0696b9
- [Doc] add LWS(LeaderWorkerSet) use case in sgl-router README (#9568) · 3aec3d4f
  Bruce-x-1997 authored Aug 25, 2025
```
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
```
  3aec3d4f
- chore: bump v0.5.1.post2 (#9592) · e3e97a12
  Yineng Zhang authored Aug 25, 2025
  
  e3e97a12
- chore: update config (#9591) · 05106867
  Yineng Zhang authored Aug 25, 2025
  
  05106867
- Tiny fix wrong comments (#9589) · 9dcdf5da
  fzyzcjy authored Aug 25, 2025
  
  9dcdf5da
- fix: resolve tuning fused moe issue (#9587) · f8b757bc
  Yineng Zhang authored Aug 25, 2025
  
  f8b757bc
- fix: revert #8593 (#9581) · ebd9dbe7
  Yineng Zhang authored Aug 25, 2025
  
  ebd9dbe7
- chore: upgrade flashinfer 0.2.14.post1 (#9578) · 938e986e
  Yineng Zhang authored Aug 25, 2025
  
  938e986e
- bugfix for undefined logging functions in HarmonyBrowserTool & HarmonyPythonTool (#9229) · 17d5eda8
  Yuhao Zhou authored Aug 25, 2025
  
  17d5eda8
- Offload tensors by sharding on GPU (#9536) · 71a7f1d8
  fzyzcjy authored Aug 25, 2025
  
  71a7f1d8
- Reintroduce memory usage fix (#9535) · 433266c1
  fzyzcjy authored Aug 25, 2025
  
  433266c1
- Update CUTLASS 4.2 & Enable K-Major Scale Factor for SM90 FP8 Blockwise Group GEMM (#9559) · fda47926
  Qi Yuhang authored Aug 25, 2025
  
  fda47926
- remove redundant rank0_log function. (#9560) · a0b22f2f
  miter authored Aug 25, 2025
```
Co-authored-by: linhuang <linhuang@ruijie.com.cn>
```
  a0b22f2f
- [PD] Improve disaggregation metrics output: update the metrics to keep... · b5c6529e
  SCDESPERTATE authored Aug 25, 2025
```
[PD] Improve disaggregation metrics output: update the metrics to keep reflecting real stats (#7317)
```
  b5c6529e
- fix: Update OpenAI client base URL in documentation (#9576) · ca4b86c5
  Xinyuan Tong authored Aug 25, 2025
  
  ca4b86c5
- Add target module validation for init adapters (#9429) · dd6ec029
  Beichen Ma authored Aug 24, 2025
  
  dd6ec029
24 Aug, 2025 5 commits
- fix: use sgl-kernel 0.3.5 (#9565) · bf863e3b
  Yineng Zhang authored Aug 24, 2025
  
  bf863e3b
- [router] add right rustls dependency in sgl-router cargo.toml (#9498) · 9e169ea8
  Bruce-x-1997 authored Aug 25, 2025
```
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
```
  9e169ea8
- chore: bump v0.5.1.post1 (#9558) · e0ab167d
  Yineng Zhang authored Aug 24, 2025
  
  e0ab167d
- chore: update configurer (#9557) · c807cd7c
  Yineng Zhang authored Aug 24, 2025
  
  c807cd7c
- fix(grok): remove duplicate replicate_lm_head configuration (#9549) · 327f7b7c
  Vincent Zhong authored Aug 23, 2025
  
  327f7b7c
23 Aug, 2025 4 commits
- [doc] deepseekv31 support (#9544) · 80425e59
  Xiaotong Jiang authored Aug 23, 2025
  
  80425e59
- [readme] Include additional resources for the SGLang x AMD SF Meetup event (#9547) · af9d4eb0
  Mingyi authored Aug 23, 2025
  
  af9d4eb0
- feat: allow use local branch to build image (#9546) · fb107cfd
  gongwei-130 authored Aug 23, 2025
  
  fb107cfd
- Release 0.5.1 (#9533) · 97a38ee8
  Lianmin Zheng authored Aug 23, 2025
  
  97a38ee8