Commits · 67e53b16f5f18fdfb2a08a42b77af8dd29057459 · change / sglang

"examples/quantize.py" did not exist on "2350a4d0b292fd4a5c77e64731e7b948ef92e8c9"

31 Jul, 2025 4 commits
- Bump transfomers to 4.54.1 to fix Gemma cache issue. (#8541) · 67e53b16
  Lifu Huang authored Jul 30, 2025
  
  67e53b16
- [Fix]Fix index oob in get_group_gemm_starts kernel. (#8564) · 9b9e8253
  Qi Yuhang authored Jul 31, 2025
  
  9b9e8253
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
- Add hf3fs support for hicache storage (based on #7704) (#7280) · 29980334
  pansicheng authored Jul 31, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  29980334
30 Jul, 2025 9 commits
- Revert "Fix the input tools format and history tool_calls in OpenAI API (#6556)" (#8584) · a79a5d70
  Chang Su authored Jul 30, 2025
  
  a79a5d70
- [Model] Add support for Arcee Foundational Model (#8154) · ec5f9442
  Adarsh Shirawalmath authored Jul 30, 2025
  
  ec5f9442
- [Hot-Fix] moe_aligned_block_size CI failed in AMD (#8461) · 3bdcdd13
  Yuan Luo authored Jul 31, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
```
  3bdcdd13
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
- Update CODEOWNERS (#8562) · 55ecdc0a
  Shangming Cai authored Jul 30, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  55ecdc0a
- Update cutlass_moe.py (#8545) · e3f08c77
  Elfie Guo authored Jul 29, 2025
  
  e3f08c77
- [router] allow longer time out for router e2e (#8560) · a9fd8033
  Simo Lin authored Jul 29, 2025
  
  a9fd8033
- feature(pd-hicache): Prefill instances support reusing the RemoteStorage Cache via HiCache. (#8516) · 2fbb754e
  hzh0425 authored Jul 30, 2025
```
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  2fbb754e
- feat(hicache): support file backend reading directory config form env. (#8498) · a85ebf50
  hzh0425 authored Jul 30, 2025
  
  a85ebf50
29 Jul, 2025 17 commits
- Support EPLB in FusedMoE (#8448) · 9effeb5b
  Cheng Wan authored Jul 29, 2025
  
  9effeb5b
- fix: temporarily disable cuda-ipc for mm data tensor (#8431) · 1992ef9b
  Mick authored Jul 30, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  1992ef9b
- bring back kimi vl ci (#8537) · c0fd77e8
  Stefan He authored Jul 29, 2025
  
  c0fd77e8
- Split the scheduler into multiple mixin classes to reduce the file size (#8483) · a4c3b121
  Lianmin Zheng authored Jul 29, 2025
  
  a4c3b121
- Fix moe align kernel test (#8531) · 5973675b
  Ke Bao authored Jul 30, 2025
  
  5973675b
- Update cutlass_moe.py (#8535) · 4d16c88b
  Elfie Guo authored Jul 29, 2025
  
  4d16c88b
- [sgl-kernel performace] fix fp8 quant kernels dispatch __nv_fp8_e4m3 bug to... · 7a4309cc
  Xiaoyu Zhang authored Jul 29, 2025
```
[sgl-kernel performace] fix fp8 quant kernels dispatch __nv_fp8_e4m3 bug to improve performance 10%-20% (#8499)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
```
  7a4309cc
- Update README.md (#8528) · 81367066
  Lianmin Zheng authored Jul 29, 2025
  
  81367066
- Always trigger pr-test (#8527) · 263c9236
  Lianmin Zheng authored Jul 29, 2025
  
  263c9236
- chore: bump v0.4.9.post6 (#8517) · 6478831b
  Yineng Zhang authored Jul 29, 2025
  
  6478831b
- Add PVC and update resource limits in k8s config (#8489) · 2e1d2d7e
  TimWang authored Jul 29, 2025
  
  2e1d2d7e
- Fix incorrect KV cache allocation for MTP models. (#8482) · fb16fbaf
  Lifu Huang authored Jul 28, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  fb16fbaf
- Support colocating requests (#7973) · 0ce84c82
  fzyzcjy authored Jul 29, 2025
  
  0ce84c82
- Tiny add warnings for DeepEP when it is suboptimal (#8426) · 59d0bf01
  fzyzcjy authored Jul 29, 2025
  
  59d0bf01
- Reduce memory usage for fp4 moe (#8413) · 7df2c0c2
  fzyzcjy authored Jul 29, 2025
  
  7df2c0c2
- Rename the last step in pr-test.yml as pr-test-finish (#8486) · 69712e6f
  Lianmin Zheng authored Jul 28, 2025
  
  69712e6f
- Update CODEOWNERS (#8485) · 001bffca
  Lianmin Zheng authored Jul 28, 2025
  
  001bffca
28 Jul, 2025 10 commits
- [CI]Add genai-bench Performance Validation for PD Router (#8477) · 7c969717
  Keyang Ru authored Jul 28, 2025
```
Co-authored-by: key4ng <rukeyang@gamil.com>
```
  7c969717
- chore: add glm 4.5 fp8 tp4 config (#8480) · 8240a6b0
  Yineng Zhang authored Jul 28, 2025
  
  8240a6b0
- chore: add glm4 fp8 tp8 config (#8478) · 3a04aa4b
  Yineng Zhang authored Jul 28, 2025
  
  3a04aa4b
- Update codeowner (#8476) · bd516949
  Lianmin Zheng authored Jul 28, 2025
  
  bd516949
- Fix DEEPEP BF16 compatibility for Deepseek Style model like GLM 4.5 (#8469) · 74e7e457
  Stefan He authored Jul 28, 2025
```
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
```
  74e7e457
- feat: support glm4 tuning (#8473) · 1466c1b8
  Yineng Zhang authored Jul 28, 2025
  
  1466c1b8
- [3/N] MoE Refactor: Simplify DeepEP Output (#8421) · 9c138a04
  Cheng Wan authored Jul 28, 2025
  
  9c138a04
- Fix parsing ChatCompletionMessage (#7273) · c8f549d9
  Timofey authored Jul 28, 2025
```
Co-authored-by: Timofey K <timosha1113@gmail.com>
```
  c8f549d9
- [NVIDIA] Change to use `num_local_experts` (#8453) · 134fa43e
  Kaixi Hou authored Jul 28, 2025
  
  134fa43e
- fix: update dep (#8467) · ccfe52a0
  Yineng Zhang authored Jul 28, 2025
  
  ccfe52a0