Commits · 4a102a2b02f120fc84c481019e35b2b041ce06f7 · change / sglang · GitLab

10 Jun, 2025 16 commits
- Minor style fix in cuda_graph_runner.py (#7053) · 4a102a2b
  Lianmin Zheng authored Jun 10, 2025
  
  4a102a2b
- Clean up server_args.py (#7037) · 6406408a
  Lianmin Zheng authored Jun 10, 2025
  
  6406408a
- Fix eagle on AMD (#7051) · 019851d0
  Lianmin Zheng authored Jun 10, 2025
  
  019851d0
- Minor cleanup of fa3 backend (#6999) · 2dae104d
  Lianmin Zheng authored Jun 10, 2025
  
  2dae104d
- fix 24.12 docker (#7045) · cef6655b
  Yineng Zhang authored Jun 10, 2025
  
  cef6655b
- [Docker] Upgrading base image from 24.04 to 24.12 (#7043) · 27196d41
  Swipe4057 authored Jun 10, 2025
  
  27196d41
- Update README.md (#7040) · bb185b0e
  Lianmin Zheng authored Jun 10, 2025
  
  bb185b0e
- chore: bump v0.4.7 (#7038) · 4f723edd
  Yineng Zhang authored Jun 10, 2025
  
  4f723edd
- CPU: map changes from developing branch in sgl-kernel (#6833) · fcde67b0
  YanbingJiang authored Jun 10, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fcde67b0
- Fix fused_moe triton configs (#7029) · 81372f3b
  yudian0504 authored Jun 10, 2025
  
  81372f3b
- [CI] Add CI workflow for sgl-router docker build (#7027) · baa6624d
  Arthur Cheng authored Jun 09, 2025
  
  baa6624d
- Add decode req pool (#6980) · c2b16795
  Byron Hsu authored Jun 09, 2025
  
  c2b16795
- Support both approximate and exact expert distribution collection (#6964) · f6ebba53
  fzyzcjy authored Jun 10, 2025
  
  f6ebba53
- Update default settings for blackwell (#7023) · 6716b417
  Baizhou Zhang authored Jun 09, 2025
  
  6716b417
- chore: update pr test xeon (#7018) · 1c8b42c8
  Yineng Zhang authored Jun 09, 2025
  
  1c8b42c8
- Fix torch version in blackwell dockerfile (#7017) · f20f7000
  Qiaolin Yu authored Jun 09, 2025
  
  f20f7000
09 Jun, 2025 20 commits
- Migrate to assertEqual (#6741) · f40942ad
  Emmanuel Ferdman authored Jun 10, 2025
```
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
```
  f40942ad
- Simplify prepare_extend_after_decode (#6987) · dc0705a5
  Lianmin Zheng authored Jun 09, 2025
  
  dc0705a5
- Fix torchvision version for Blackwell (#7015) · a968c888
  Wenxuan Tan authored Jun 09, 2025
  
  a968c888
- Fallback to lower triton version for unfound fused moe configs (#7013) · a979daac
  Baizhou Zhang authored Jun 09, 2025
  
  a979daac
- feat: add direct routing strategy to DP worker (#6884) · f1569876
  ishandhanani authored Jun 09, 2025
  
  f1569876
- Update amd nightly models CI. (#6992) · 3465d7ae
  Sai Enduri authored Jun 09, 2025
  
  3465d7ae
- Fix cutlass MLA gets almost zero accuracy (#6998) · e58423b2
  fzyzcjy authored Jun 10, 2025
  
  e58423b2
- chore: update pr test xeon (#7008) · 7059ae16
  Yineng Zhang authored Jun 09, 2025
  
  7059ae16
- cleanup tmp dir (#7007) · 51d9a597
  Yineng Zhang authored Jun 09, 2025
  
  51d9a597
- chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2
  Yineng Zhang authored Jun 09, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
```
  56ccd3c2
- Fix torch profiler bugs for bench_offline_throughput.py (#6557) · 98c00a2d
  Yueyang Pan authored Jun 09, 2025
  
  98c00a2d
- support qwen3 emebedding (#6990) · 451ffe74
  uylnap authored Jun 09, 2025
  
  451ffe74
- Eliminate stream sync to speed up LoRA batch init (#6960) · b1e5a33a
  Lifu Huang authored Jun 09, 2025
  
  b1e5a33a
- Use torch.compile to fuse flash attention decode metadata preparation (#6973) · 9d5fa68b
  Lianmin Zheng authored Jun 08, 2025
  
  9d5fa68b
- Enable more unit tests for AMD CI. (#6983) · 2c186425
  Sai Enduri authored Jun 08, 2025
  
  2c186425
- [perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128 (#6929) · 18efb5e8
  JieXin Liang authored Jun 09, 2025
  
  18efb5e8
- Minor remove one kernel for DeepSeek (#6977) · de1350ea
  fzyzcjy authored Jun 09, 2025
  
  de1350ea
- Fix expert distribution dumping causes OOM (#6967) · 86fe943b
  fzyzcjy authored Jun 09, 2025
  
  86fe943b
- Fix triton sliding window test case (#6981) · 9ecb1856
  Lianmin Zheng authored Jun 08, 2025
  
  9ecb1856
- Fix draft extend ut stability with flush cache (#6979) · cc74499d
  Ke Bao authored Jun 09, 2025
  
  cc74499d
08 Jun, 2025 4 commits
- Sync cuda graph runners (#6976) · 0c1f03a2
  Lianmin Zheng authored Jun 08, 2025
  
  0c1f03a2
- Fuse routed scaling factor in deepseek (#6970) · 3712abfa
  Xiaoyu Zhang authored Jun 09, 2025
  
  3712abfa
- Extend cuda graph capture bs for B200 (#6937) · 971a0dfa
  Baizhou Zhang authored Jun 08, 2025
  
  971a0dfa
- Remove unnecessary kernels of num_token_non_padded (#6965) · 2fc12995
  fzyzcjy authored Jun 08, 2025
  
  2fc12995