Commits · 8aab7fdb21e86b87a3141951ce498246fd4aae73 · change / sglang · GitLab

15 Apr, 2025 11 commits
- chore: upgrade sgl-kernel 0.0.9 (#5401) · 8aab7fdb
  Yineng Zhang authored Apr 14, 2025
  
  8aab7fdb
- chore: bump sgl-kernel 0.0.9 (#5400) · e940dc4f
  Yineng Zhang authored Apr 14, 2025
  
  e940dc4f
- kernel: support slightly faster merge_state_v2 cuda kernel (#5381) · 388e15c0
  DefTruth authored Apr 15, 2025
  
  388e15c0
- fix: update pr-test-sgl-kernel (#5399) · 11421a3f
  Yineng Zhang authored Apr 14, 2025
  
  11421a3f
- chore: upgrade DeepGEMM (#5395) · 6c41fcf0
  Yineng Zhang authored Apr 14, 2025
  
  6c41fcf0
- [fix/misc] remove duplicate row in deepseek v2 model (#5279) · ee9d6ca6
  Yangcheng Li authored Apr 15, 2025
  
  ee9d6ca6
- Add H20 dtype fp8_w8a8 shared experts fused MoE kernel tuning configs for DeepSeek V3/R1 (#5291) · 2dd64894
  Ximingwang-09 authored Apr 15, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  2dd64894
- Add A800 shared experts fused MoE kernel tuning configs for DeepSeek V3/R1 (#5368) · 61e7c4dd
  lambert0312 authored Apr 15, 2025
  
  61e7c4dd
- minor clean up of sgl-kernel/CMakeLists.txt (#5393) · dae79444
  Lianmin Zheng authored Apr 14, 2025
  
  dae79444
- [Fix] Turn off DeepGEMM by default (#5263) · f6772f14
  Baizhou Zhang authored Apr 14, 2025
  
  f6772f14
- fix: update test config (#5392) · ac5b78ba
  Yineng Zhang authored Apr 14, 2025
  
  ac5b78ba
14 Apr, 2025 9 commits
- apply fused moe gate in ds v3/r1 (#5371) · 38076dea
  Xiaoyu Zhang authored Apr 15, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  38076dea
- Apply deepseek cuda rope (#5385) · 5e0a9b09
  Ke Bao authored Apr 15, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  5e0a9b09
- [perf] experimental enhance fp8 per-tensor quant (#5370) · bdde2375
  JieXin Liang authored Apr 15, 2025
  
  bdde2375
- [PD Bug] fix MLA get_contiguous_buf_infos error (#5384) · e9fc2ac7
  ybyang authored Apr 14, 2025
  
  e9fc2ac7
- Fix PD disaggregation bugs (#5326) · 44afde82
  Liangsheng Yin authored Apr 14, 2025
  
  44afde82
- Support for Qwen2.5-VL Model in bitsandbytes Format (#5003) · 072df753
  yhyang201 authored Apr 14, 2025
  
  072df753
- Fix DeepSeek DP Attention + torch compile (#5367) · defede50
  fzyzcjy authored Apr 14, 2025
```
Co-authored-by: ispobock <ispobaoke@163.com>
```
  defede50
- Free metadata_buffer_index after transfer finished (#5364) · fc728719
  Yongtong Wu authored Apr 14, 2025
  
  fc728719
- Free metadata_buffer_index after transfer finished (#5364) · 14e8bd88
  Yongtong Wu authored Apr 14, 2025
  
  14e8bd88
13 Apr, 2025 12 commits
- [DeepEP] Reduce routed scaling overhead (#5277) · adca585b
  yulei authored Apr 14, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  adca585b
- feat: update experiment_runner (#5360) · 39d90449
  Yineng Zhang authored Apr 13, 2025
  
  39d90449
- fix #5322 (#5359) · 39e41138
  Yineng Zhang authored Apr 13, 2025
  
  39e41138
- fix MLATokenToKVPoolHost get_size_per_token bug (#5161) · 5fbafbb8
  huangtingwei authored Apr 14, 2025
```
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
```
  5fbafbb8
- [PD] Add transfer backend abstraction (#5328) · a9499885
  Byron Hsu authored Apr 13, 2025
  
  a9499885
- Fix typo: infight -> inflight (#5357) · f7655790
  Liangsheng Yin authored Apr 14, 2025
  
  f7655790
- chore: upgrade sgl-kernel 0.0.8.post3 (#5342) · f58b929a
  Yineng Zhang authored Apr 13, 2025
  
  f58b929a
- docs: update adoption and sponsorship list with Oracle (#5343) · c1270aab
  Yineng Zhang authored Apr 12, 2025
  
  c1270aab
- Fix: Ensure tensors for dist.broadcast match NCCL backend device (#5322) · 8311b07f
  mlmz authored Apr 13, 2025
  
  8311b07f
- misc: update sagemaker Dockerfile (#5341) · c1380257
  Yineng Zhang authored Apr 12, 2025
  
  c1380257
- feat: adapt merge_state (#5337) · b62e7e99
  Yineng Zhang authored Apr 12, 2025
  
  b62e7e99
- fix: determine if flashinfer is installed (#5336) · 7d3b7c87
  Yineng Zhang authored Apr 12, 2025
  
  7d3b7c87
12 Apr, 2025 8 commits
- ci: update release node (#5333) · 75015bb6
  Yineng Zhang authored Apr 12, 2025
  
  75015bb6
- chore: bump sgl-kernel v0.0.8.post3 (#5332) · b371f7cd
  Yineng Zhang authored Apr 12, 2025
  
  b371f7cd
- fix: solve cu118 issue for cutlass mla (#5331) · 812e82f3
  Yineng Zhang authored Apr 12, 2025
  
  812e82f3
- [Feat] Add sparse attn to sgl-kernel (#5327) · 4879e50c
  PGFLMG authored Apr 13, 2025
  
  4879e50c
- Support server based rollout in Verlengine (#4848) · bc92107b
  tianlian yi authored Apr 13, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jinn <47354855+jhinpan@users.noreply.github.com>
```
  bc92107b
- refine fused_moe tuning docs (#5294) · 3e4794aa
  Xiaoyu Zhang authored Apr 13, 2025
  
  3e4794aa
- Delete python/sglang/srt/layers/moe/fused_moe_triton/configs/E=257,N=… (#5321) · 690ec205
  Xiaoyu Zhang authored Apr 13, 2025
  
  690ec205
- Fix: docs/backend/structured_outputs.ipynb (#4884) · 2074a2e6
  thyecust authored Apr 12, 2025
  
  2074a2e6