Commits · b783c1cb829ec451639d1a3ce68380fb7a7be4a3 · change / sglang

18 Jun, 2025 2 commits
- Fix hicache benchmark script bug - some sampled input_request is [] (#7300) · b783c1cb
  Binyao Jiang authored Jun 17, 2025
  
  b783c1cb
- Upstreaming hicache bug fixes (#7267) · e56685ac
  Zhiqiang Xie authored Jun 17, 2025
  
  e56685ac
16 Jun, 2025 3 commits
- chore: bump v0.4.7.post1 (#7248) · f9dc9dd2
  Yineng Zhang authored Jun 16, 2025
  
  f9dc9dd2
- refine fused_moe benchmark (#7221) · 0ae1e9a7
  Xiaoyu Zhang authored Jun 16, 2025
  
  0ae1e9a7
- Support LoRA in MMMU benchmark script. (#7218) · e07d0647
  Lifu Huang authored Jun 15, 2025
  
  e07d0647
12 Jun, 2025 1 commit
- Fix positional argument (#7093) · ef326774
  Quanfeng Li authored Jun 12, 2025
  
  ef326774
10 Jun, 2025 1 commit
- chore: bump v0.4.7 (#7038) · 4f723edd
  Yineng Zhang authored Jun 10, 2025
  
  4f723edd
08 Jun, 2025 3 commits
- Fuse routed scaling factor in deepseek (#6970) · 3712abfa
  Xiaoyu Zhang authored Jun 09, 2025
  
  3712abfa
- rebase h20 fused_moe config (#6966) · fa3592cf
  Xiaoyu Zhang authored Jun 08, 2025
  
  fa3592cf
- Revert "Fuse routed scaling factor in topk_reduce kernel (#6220)" (#6968) · 1fb76ebb
  Yineng Zhang authored Jun 07, 2025
  
  1fb76ebb
07 Jun, 2025 2 commits
- Fuse routed scaling factor in topk_reduce kernel (#6220) · 515ef4fa
  Xiaoyu Zhang authored Jun 08, 2025
  
  515ef4fa
- add fbgemm moe grouped gemm kernel benchmark (#6924) · bae4fdc7
  Xiaoyu Zhang authored Jun 07, 2025
  
  bae4fdc7
05 Jun, 2025 1 commit
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 2 commits
- Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts... · 81964328
  Cheng Wan authored Jun 04, 2025
```
Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)
```
  81964328
- [Refactor] Rename `n_share_experts_fusion` as `num_fused_shared_experts` (#6735) · 8a548052
  Cheng Wan authored Jun 03, 2025
  
  8a548052
29 May, 2025 3 commits
- [test] add ut and bm for get_last_loc (#6746) · d9d35def
  JieXin Liang authored May 30, 2025
  
  d9d35def
- Support tuning DeepEP configs (#6742) · 6df81e8a
  fzyzcjy authored May 29, 2025
  
  6df81e8a
- refactor apply_w8a8_block_fp8_linear in fp (#6545) · 485a023b
  ChangyiYang authored May 29, 2025
  
  485a023b
28 May, 2025 3 commits
- Fix LoRA bench (#6719) · 844a8f42
  Wenxuan Tan authored May 28, 2025
  
  844a8f42
- fix log_info_on_rank0 error when run benchmark (#6260) · 07610353
  Xiaoyu Zhang authored May 28, 2025
  
  07610353
- Refine pre_reorder_triton_kernel slightly to improve performance (#6627) · c087ddd6
  Yuan Luo authored May 28, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  c087ddd6
24 May, 2025 1 commit
- chore: bump v0.4.6.post5 (#6566) · 7e257cd6
  Yineng Zhang authored May 24, 2025
  
  7e257cd6
15 May, 2025 1 commit
- Fix lora bench (#6302) · cd8d4b9d
  Qiaolin Yu authored May 15, 2025
  
  cd8d4b9d
13 May, 2025 1 commit
- chore: bump v0.4.6.post4 (#6245) · 16267d4f
  Yineng Zhang authored May 13, 2025
  
  16267d4f
12 May, 2025 3 commits
- Support tuning moe for llama 4 model (#6042) · ef8ec07b
  fzyzcjy authored May 13, 2025
  
  ef8ec07b
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
11 May, 2025 2 commits
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
09 May, 2025 1 commit
- chore: bump v0.4.6.post3 (#6165) · 678d8cc9
  Yineng Zhang authored May 09, 2025
  
  678d8cc9
02 May, 2025 2 commits
- Support MMMU benchmark for InternVL (#5968) · 6ea1e6ac
  XinyuanTong authored May 02, 2025
  
  6ea1e6ac
- feat: add concurrency evaluation logic in mmmu benchmark (#5782) · c5645e92
  XinyuanTong authored May 01, 2025
  
  c5645e92
01 May, 2025 1 commit
- chore: bump v0.4.6.post2 (#5939) · 9858113c
  Yineng Zhang authored Apr 30, 2025
  
  9858113c
30 Apr, 2025 1 commit
- support vlm benchmark profile (#5905) · d50e36a7
  Yi Zhang authored Apr 30, 2025
  
  d50e36a7
29 Apr, 2025 2 commits
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
- simplify fused_moe config logging (#5801) · 1cc32603
  Xiaoyu Zhang authored Apr 29, 2025
  
  1cc32603
28 Apr, 2025 3 commits
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- fused moe triton tuning script support qwen3 (#5842) · e132cba2
  Xiaoyu Zhang authored Apr 29, 2025
  
  e132cba2