Commits · 067068f27173b41a6bec437be7bbfcb3e355b080 · zhaoyu6 / sglang

"docs/advanced_features/function_calling.ipynb" did not exist on "7443197a63de26350fb6785377f20a0cbf491118"

11 Aug, 2025 9 commits
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
- Update REVIEWERS.md (#9046) · 6beeff41
  Lianmin Zheng authored Aug 10, 2025
  
  6beeff41
- Improve docs and developer guide (#9044) · 2e8e7e35
  Lianmin Zheng authored Aug 10, 2025
  
  2e8e7e35
- Refactor the docs (#9031) · 2449a0af
  Lianmin Zheng authored Aug 10, 2025
  
  2449a0af
- Update release-docs.yml (#9037) · 0f229c07
  Lianmin Zheng authored Aug 10, 2025
  
  0f229c07
- chore: upgrade flashinfer 0.2.11 (#9036) · dd001a54
  Yineng Zhang authored Aug 10, 2025
  
  dd001a54
- Simplify health check (#9034) · 4ea9d74a
  Lianmin Zheng authored Aug 10, 2025
  
  4ea9d74a
- Revert "[1/2][resubmit] sgl-kernel: Fuse routed scaling factor into m… (#9035) · dd949ace
  Yineng Zhang authored Aug 10, 2025
  
  dd949ace
- Simplify memory pool (#9033) · f2887498
  Lianmin Zheng authored Aug 10, 2025
  
  f2887498
10 Aug, 2025 16 commits
- Support Flatten Tensor Update Weights to speed up MOE Update Weights by 20% (#8079) · 8ecf6b9d
  Stefan He authored Aug 10, 2025
  
  8ecf6b9d
- [Optimization] Update estimated_num_new_pages logic in TokenToKVPoolAllocator (#8794) · 0418b9d4
  YiXR authored Aug 11, 2025
```
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
Co-authored-by: Xingrui Yi <yixingrui@linux.alibaba.com>
```
  0418b9d4
- Reduce CI duration of test_lora_update. (#9024) · e322a94d
  Lifu Huang authored Aug 10, 2025
  
  e322a94d
- Reorganize CI and test files (#9027) · 2c7f01bc
  Lianmin Zheng authored Aug 10, 2025
  
  2c7f01bc
- Simplify frontend language (#9029) · b58ae7a2
  Lianmin Zheng authored Aug 10, 2025
  
  b58ae7a2
- [RL] Add test for /abort_request (#7626) · 6345069f
  Stefan He authored Aug 10, 2025
  
  6345069f
- [router] update pyo3 version to 0.25.1 (#9022) · ce9cf353
  Simo Lin authored Aug 10, 2025
  
  ce9cf353
- Improve LoRA Perf by Deprecating FlashInfer and Eliminating Redundant Tensor Ops (#8940) · f8a173bb
  Lifu Huang authored Aug 10, 2025
  
  f8a173bb
- Optimize: Cache CUDA device to reduce redundant calls during tensor l… (#8996) · 6b847a9a
  JiLi authored Aug 10, 2025
  
  6b847a9a
- [router] upgrade kube version to latest (#9018) · 473400e4
  Simo Lin authored Aug 09, 2025
  
  473400e4
- [router] upgrade rand to latest version (#9017) · dd665f96
  Simo Lin authored Aug 09, 2025
  
  dd665f96
- [router] upgrade to latest sgl kernel for router ci (#9019) · 3817a37d
  Simo Lin authored Aug 09, 2025
  
  3817a37d
- [Fix] Fix flashinfer cpu <-> gpu synchronization (#8340) · 7ba5ad57
  DarkSharpness authored Aug 09, 2025
  
  7ba5ad57
- [Fix] Fix hicache backend (#8991) · 19bc77f0
  DarkSharpness authored Aug 09, 2025
  
  19bc77f0
- fix page first per layer pf2lf kernel (#8915) · 86497d99
  huangtingwei authored Aug 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  86497d99
- [hicache] Optimization for DMA copy (#8245) · 5c31b35d
  cctry authored Aug 09, 2025
  
  5c31b35d
09 Aug, 2025 15 commits
- Fix CI (#9013) · ef48d554
  Lianmin Zheng authored Aug 09, 2025
  
  ef48d554
- fix flashinfer allreduce fusion import bug (#9007) · a886564a
  Xiaoyu Zhang authored Aug 10, 2025
  
  a886564a
- Fix CI (#9012) · 9a44b643
  Lianmin Zheng authored Aug 09, 2025
  
  9a44b643
- fix: fix obsolete qwen-audio processor arg (#9003) · 41d71ca4
  Mick authored Aug 10, 2025
  
  41d71ca4
- [perf] add kimi-k2 b200 fused moe config (#9010) · 20cfc5a2
  JieXin Liang authored Aug 10, 2025
  
  20cfc5a2
- fix nvshmem cu126 (#9001) · 48b8b4c1
  Yineng Zhang authored Aug 09, 2025
  
  48b8b4c1
- Enable TBO on ROCm (#8329) · 323bc2f5
  Chaitanya Sri Krishna Lolla authored Aug 09, 2025
  
  323bc2f5
- [Feature] Optimize DeepSeek's DeepEP on Ascend NPU (#8355) · 137e75da
  Even Zhou authored Aug 09, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Hexq0210 <hexq0809521@gmail.com>
```
  137e75da
- [bugfix] Fix missing args in bench one batch (#8877) · 52e1f52f
  Trevor Morris authored Aug 09, 2025
  
  52e1f52f
- [DP] fix: engine crash when decode batch is padded (#8995) · 50188092
  Cheng Wan authored Aug 09, 2025
  
  50188092
- chore: upgrade sgl-kernel 0.3.3 (#8998) · 326a901d
  Yineng Zhang authored Aug 09, 2025
  
  326a901d
- HiCache Storage tp fix (#8878) · 6e0b6468
  Zhiqiang Xie authored Aug 09, 2025
  
  6e0b6468
- Tiny Llama4 type error in constructor (#6752) · 4a9f3eef
  Brayden Zhong authored Aug 09, 2025
  
  4a9f3eef
- feature(hicache): Support hf3fs-hicache reusing kvcache across different instances (#8673) · 1b7afad0
  hzh0425 authored Aug 09, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  1b7afad0
- Support glm4.1v and glm4.5v (#8798) · f29aba8c
  Binyao Jiang authored Aug 09, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  f29aba8c