Commits · 8f019c7d1aa5e9afe39f7d091871b2192bab47b9 · change / sglang

"examples/flax/vscode:/vscode.git/clone" did not exist on "22f72185601d5167a747104b4aca102d0e92524c"

25 Feb, 2025 1 commit
- [BugFix] Fix crash when receive a req with structed output in DP attention mode. (#3841) · 10771026
  IAN authored Feb 26, 2025
  
  10771026
24 Feb, 2025 1 commit

Hierarchical Caching for SGLang (#2693) · 6c7a152c

Zhiqiang Xie authored Feb 23, 2025


Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

6c7a152c

22 Feb, 2025 1 commit
- bench: Add MMMU benchmark for vLM (#3562) · 45205d88
  Mick authored Feb 23, 2025
  
  45205d88
19 Feb, 2025 3 commits
- Variance measure for reasoning benchmark (#3677) · bb121214
  simveit authored Feb 19, 2025
  
  bb121214
- [Docs] Add SkyPilot DeepSeek example (#3706) · f93e9158
  Zhanghao Wu authored Feb 19, 2025
  
  f93e9158
- set NCCL_IB_GID_INDEX=3 for multi node NVIDIA InfiniBand if needed (#3698) · fe0673f1
  Yineng Zhang authored Feb 19, 2025
  
  fe0673f1
18 Feb, 2025 1 commit
- [ROCm] Optimal MOE Tuning for AMD Radeon Graphics (#3567) · ddf39d3f
  yigex authored Feb 18, 2025
  
  ddf39d3f
17 Feb, 2025 2 commits
- support multi-gpu block-gemm tuning (#3639) · c38f3aed
  Xiaoyu Zhang authored Feb 18, 2025
  
  c38f3aed
- [docker] added rdma support (#3619) · c9565e49
  Shenggui Li authored Feb 17, 2025
  
  c9565e49
16 Feb, 2025 1 commit
- Benchmark for reasoning models (#3532) · 3d4a8f9b
  simveit authored Feb 16, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  3d4a8f9b
14 Feb, 2025 2 commits
- update flashinfer-python (#3557) · ac963be2
  Yineng Zhang authored Feb 14, 2025
  
  ac963be2
- chore: bump v0.4.3 (#3556) · e0b9a423
  Yineng Zhang authored Feb 14, 2025
  
  e0b9a423
13 Feb, 2025 2 commits
- update README (#3543) · 20de05a7
  Yineng Zhang authored Feb 13, 2025
  
  20de05a7
- Update DeepSeek V3 Doc (#3541) · bf2a7087
  Jhin authored Feb 13, 2025
  
  bf2a7087
12 Feb, 2025 1 commit
- refine deepseek_v3 launch server doc (#3522) · 693c2600
  Xiaoyu Zhang authored Feb 12, 2025
  
  693c2600
11 Feb, 2025 1 commit
- [ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418) · fdf04a14
  yigex authored Feb 11, 2025
```
Co-authored-by: Bruce Xue <yigex@xilinx.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  fdf04a14
10 Feb, 2025 2 commits
- refine some typo (#3473) · 2f47d710
  Xiaoyu Zhang authored Feb 10, 2025
  
  2f47d710
- chore: bump v0.4.2.post4 (#3459) · cddb1cdf
  Yineng Zhang authored Feb 10, 2025
  
  cddb1cdf
08 Feb, 2025 5 commits
- fix EAGLE 2 non greedy case (#3407) · fad315cb
  Yineng Zhang authored Feb 09, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fad315cb
- fix typo · f90db8bc
  Yineng Zhang authored Feb 08, 2025
  
  f90db8bc
- Add deepseek-v3 a100 serving example (#3404) · d8ad5970
  Ke Bao authored Feb 08, 2025
  
  d8ad5970
- Update fused_moe's benchmark (#3346) · 849f58d6
  GaoYuYang authored Feb 08, 2025
  
  849f58d6
- [BUG] fix moe benchmark when bs*seq is small (#3382) · 64480df4
  yiakwy-xpu-ml-framework-team authored Feb 08, 2025
  
  64480df4
07 Feb, 2025 1 commit
- chore: bump v0.4.2.post3 (#3369) · c1f5f99f
  Yineng Zhang authored Feb 08, 2025
  
  c1f5f99f
06 Feb, 2025 4 commits
- optimize moe_align_kernel cuda (#3347) · cdae77b0
  Xiaoyu Zhang authored Feb 07, 2025
  
  cdae77b0
- [Doc] Add optimization option guide for deepseek v3 (#3349) · 6792411e
  Ke Bao authored Feb 06, 2025
  
  6792411e
- add AMD guide for DeepSeek-R1 (#3338) · 7348d962
  Yineng Zhang authored Feb 06, 2025
  
  7348d962
- clean moe align block kernel code and add acc test (#3332) · ad349985
  Xiaoyu Zhang authored Feb 06, 2025
  
  ad349985
05 Feb, 2025 1 commit
- update README (#3324) · 07e58a2d
  Yineng Zhang authored Feb 06, 2025
  
  07e58a2d
04 Feb, 2025 1 commit
- [Feature] Define backends and add Triton backend for Lora (#3161) · 70817a7e
  Baizhou Zhang authored Feb 03, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  70817a7e
31 Jan, 2025 1 commit
- add tuning block wise fp8 (#3242) · 7b020cca
  Yineng Zhang authored Feb 01, 2025
```
Co-authored-by: HandH1998 <007aabbcc411@gmail.com>
```
  7b020cca
27 Jan, 2025 1 commit
- add dsv3 mi300 triton config for block scale (#3146) · 351a72d4
  yigex authored Jan 27, 2025
  
  351a72d4
26 Jan, 2025 1 commit
- Use torch.compile for scaling penalty (#3133) · 27acf63b
  Lianmin Zheng authored Jan 25, 2025
  
  27acf63b
23 Jan, 2025 1 commit
- support lightning_attention_decode in sgl-kernel for MiniMax-Text-01 (#3030) · ac2dc35d
  Xiaoyu Zhang authored Jan 23, 2025
  
  ac2dc35d
20 Jan, 2025 1 commit
- fix moe align blocks benchmark (#3003) · 10bfce71
  yiakwy-xpu-ml-framework-team authored Jan 20, 2025
  
  10bfce71
19 Jan, 2025 1 commit
- fix file name spelling mistake and useless variable in minmax-text-01-lightning_attention (#2971) · 83452dbb
  Xiaoyu Zhang authored Jan 19, 2025
  
  83452dbb
18 Jan, 2025 2 commits
- optimize MiniMax-Text-01 lightning_attn_decode triton (#2966) · c2f212d6
  Xiaoyu Zhang authored Jan 18, 2025
  
  c2f212d6
- Multi-turn benchmark for hierarchical caching (#2942) · 13387e6b
  Zhiqiang Xie authored Jan 17, 2025
  
  13387e6b
16 Jan, 2025 2 commits
- [kernel] MiniMax-Text-01 decode lightning_attn with triton (#2920) · 78e974b2
  Xiaoyu Zhang authored Jan 17, 2025
  
  78e974b2
- Improve type annotation and styles (#2926) · bc6915e3
  Lianmin Zheng authored Jan 16, 2025
  
  bc6915e3