Commits · fa3592cfeb9d7d008e31719fdf68f3dc7d5ad9dd · change / sglang

08 Jun, 2025 2 commits
- rebase h20 fused_moe config (#6966) · fa3592cf
  Xiaoyu Zhang authored Jun 08, 2025
  
  fa3592cf
- Revert "Fuse routed scaling factor in topk_reduce kernel (#6220)" (#6968) · 1fb76ebb
  Yineng Zhang authored Jun 07, 2025
  
  1fb76ebb
07 Jun, 2025 2 commits
- Fuse routed scaling factor in topk_reduce kernel (#6220) · 515ef4fa
  Xiaoyu Zhang authored Jun 08, 2025
  
  515ef4fa
- add fbgemm moe grouped gemm kernel benchmark (#6924) · bae4fdc7
  Xiaoyu Zhang authored Jun 07, 2025
  
  bae4fdc7
05 Jun, 2025 1 commit
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 2 commits
- Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts... · 81964328
  Cheng Wan authored Jun 04, 2025
```
Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)
```
  81964328
- [Refactor] Rename `n_share_experts_fusion` as `num_fused_shared_experts` (#6735) · 8a548052
  Cheng Wan authored Jun 03, 2025
  
  8a548052
29 May, 2025 3 commits
- [test] add ut and bm for get_last_loc (#6746) · d9d35def
  JieXin Liang authored May 30, 2025
  
  d9d35def
- Support tuning DeepEP configs (#6742) · 6df81e8a
  fzyzcjy authored May 29, 2025
  
  6df81e8a
- refactor apply_w8a8_block_fp8_linear in fp (#6545) · 485a023b
  ChangyiYang authored May 29, 2025
  
  485a023b
28 May, 2025 3 commits
- Fix LoRA bench (#6719) · 844a8f42
  Wenxuan Tan authored May 28, 2025
  
  844a8f42
- fix log_info_on_rank0 error when run benchmark (#6260) · 07610353
  Xiaoyu Zhang authored May 28, 2025
  
  07610353
- Refine pre_reorder_triton_kernel slightly to improve performance (#6627) · c087ddd6
  Yuan Luo authored May 28, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  c087ddd6
24 May, 2025 1 commit
- chore: bump v0.4.6.post5 (#6566) · 7e257cd6
  Yineng Zhang authored May 24, 2025
  
  7e257cd6
15 May, 2025 1 commit
- Fix lora bench (#6302) · cd8d4b9d
  Qiaolin Yu authored May 15, 2025
  
  cd8d4b9d
13 May, 2025 1 commit
- chore: bump v0.4.6.post4 (#6245) · 16267d4f
  Yineng Zhang authored May 13, 2025
  
  16267d4f
12 May, 2025 3 commits
- Support tuning moe for llama 4 model (#6042) · ef8ec07b
  fzyzcjy authored May 13, 2025
  
  ef8ec07b
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
11 May, 2025 2 commits
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
10 May, 2025 1 commit
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
09 May, 2025 1 commit
- chore: bump v0.4.6.post3 (#6165) · 678d8cc9
  Yineng Zhang authored May 09, 2025
  
  678d8cc9
02 May, 2025 2 commits
- Support MMMU benchmark for InternVL (#5968) · 6ea1e6ac
  XinyuanTong authored May 02, 2025
  
  6ea1e6ac
- feat: add concurrency evaluation logic in mmmu benchmark (#5782) · c5645e92
  XinyuanTong authored May 01, 2025
  
  c5645e92
01 May, 2025 1 commit
- chore: bump v0.4.6.post2 (#5939) · 9858113c
  Yineng Zhang authored Apr 30, 2025
  
  9858113c
30 Apr, 2025 1 commit
- support vlm benchmark profile (#5905) · d50e36a7
  Yi Zhang authored Apr 30, 2025
  
  d50e36a7
29 Apr, 2025 2 commits
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
- simplify fused_moe config logging (#5801) · 1cc32603
  Xiaoyu Zhang authored Apr 29, 2025
  
  1cc32603
28 Apr, 2025 4 commits
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- fused moe triton tuning script support qwen3 (#5842) · e132cba2
  Xiaoyu Zhang authored Apr 29, 2025
  
  e132cba2
- feat: Add fused moe triton config for qwen3 moe on h100 (#5833) · 0045f4b2
  XinyuanTong authored Apr 28, 2025
  
  0045f4b2
27 Apr, 2025 1 commit
- Release v0.4.6 (#5795) · 84022c0e
  Baizhou Zhang authored Apr 27, 2025
  
  84022c0e
25 Apr, 2025 1 commit
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
24 Apr, 2025 1 commit
- vlm: enable radix cache for qwen-vl models (#5349) · c998d04b
  Mick authored Apr 24, 2025
```
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  c998d04b
22 Apr, 2025 1 commit
- chore: bump v0.4.5.post3 (#5611) · b9c87e78
  Yineng Zhang authored Apr 21, 2025
  
  b9c87e78
21 Apr, 2025 1 commit
- Perform Batch Tokenization. (#5141) · f0815419
  Sundara Raman Ramachandran authored Apr 20, 2025
  
  f0815419
20 Apr, 2025 2 commits
- [Feat] upgrade pytorch2.6 (#5417) · 417b44eb
  lukec authored Apr 21, 2025
  
  417b44eb
- Minor update for ROCm variable style (#5562) · c555d794
  Zhaoyi Li authored Apr 20, 2025
  
  c555d794