Commits · dcae1fb2cd2def2a2eb4919c21f74e91d888d161 · change / sglang · GitLab

28 Apr, 2025 25 commits
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- feat: update is_fa3_default_architecture (#5854) · 663037a7
  Yineng Zhang authored Apr 28, 2025
  
  663037a7
- [Fix] Missing bootstrap_port field (#5823) · f4a9f60c
  XTY authored Apr 29, 2025
  
  f4a9f60c
- [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) · ee71ed8a
  PGFLMG authored Apr 29, 2025
```
Co-authored-by: sighingnow <sighingnow@gmail.com>
```
  ee71ed8a
- ROCm: update AITER (#5816) · d364b9b0
  HAI authored Apr 28, 2025
  
  d364b9b0
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- feat: Add fused moe triton config for qwen3-30b-fp8 moe on h20 (#5850) · d73ddeb1
  JiLi authored Apr 29, 2025
  
  d73ddeb1
- [Doc] Recover history of server_arguments.md (#5851) · f48b007c
  Baizhou Zhang authored Apr 28, 2025
  
  f48b007c
- [config] qwen3moe_tune_h20 fp8 tp4 (#5846) · 74cb12a8
  ybyang authored Apr 29, 2025
  
  74cb12a8
- [PD] support pd fake transfer for warmup (#5726) · c6c62640
  ybyang authored Apr 29, 2025
  
  c6c62640
- feat: Add fused moe triton config for qwen3bf16 moe on h20 (#5839) · 92ab0a20
  yhyang201 authored Apr 29, 2025
  
  92ab0a20
- fused moe triton tuning script support qwen3 (#5842) · e132cba2
  Xiaoyu Zhang authored Apr 29, 2025
  
  e132cba2
- feat: Add fused moe triton config for qwen3 moe on h100 (#5833) · 0045f4b2
  XinyuanTong authored Apr 28, 2025
  
  0045f4b2
- fix: fix the error where the content is None when reasoning and tool … (#5838) · 8601300b
  mlmz authored Apr 28, 2025
  
  8601300b
- Feat: add support for thinking mode via chat_template_kwargs.enable_t… (#5551) · 6fa6f38e
  mlmz authored Apr 28, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  6fa6f38e
- Revert "Tiny refactor DefaultModelLoader.Source" (#5825) · 693723d1
  Lianmin Zheng authored Apr 28, 2025
  
  693723d1
- [Docs] Replace lists with tables for cleanup and readability in server_arguments (#5276) · 966eb908
  Michael Yao authored Apr 28, 2025
  
  966eb908
- Tiny refactor DefaultModelLoader.Source (#5482) · 644ed409
  fzyzcjy authored Apr 28, 2025
  
  644ed409
- Turn on overlap scheduler for multimodal models (#5771) · 3029889c
  Lianmin Zheng authored Apr 27, 2025
  
  3029889c
- Add a doc to fix sgl-kernel build link error in py39 with ccache (#5809) · ef15dcda
  Xiaoyu Zhang authored Apr 28, 2025
  
  ef15dcda
- Dockerfile.dev pip scikit_build_core (#5807) · ad4df307
  Xiaoyu Zhang authored Apr 28, 2025
  
  ad4df307
- chore: upgrade sgl-kernel 0.1.0 (#5690) · 41ac0c6d
  Yineng Zhang authored Apr 27, 2025
  
  41ac0c6d
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
- Improve overlap scheduling (#5788) · 40d9b8ac
  Liangsheng Yin authored Apr 28, 2025
  
  40d9b8ac
27 Apr, 2025 15 commits
- [Misc] add structure logging, write to file and log tracing for SGL Router · f0365820
  Simo Lin authored Apr 27, 2025
  
  f0365820
- [Docs] update grafana setup guide in production metrics (#5643) · 86317c09
  Huapeng Zhou authored Apr 28, 2025
```
Co-authored-by: NoahM <88418672+zhudianGG@users.noreply.github.com>
```
  86317c09
- [CI] Improve github summary & enable fa3 for more models (#5796) · daed453e
  Lianmin Zheng authored Apr 27, 2025
  
  daed453e
- Update nightly-test.yml (#5797) · ded04b2e
  Lianmin Zheng authored Apr 27, 2025
  
  ded04b2e
- Release v0.4.6 (#5795) · 84022c0e
  Baizhou Zhang authored Apr 27, 2025
  
  84022c0e
- Add 8-GPU Test for Deepseek-V3 (#5691) · f9fb33ef
  Baizhou Zhang authored Apr 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  f9fb33ef
- [CI] Fix test case (#5790) · a38f6932
  Lianmin Zheng authored Apr 27, 2025
  
  a38f6932
- [PD]Reduce kv transfer threads (#5791) · beb65c74
  Liangsheng Yin authored Apr 27, 2025
  
  beb65c74
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
- [CI] fix port conflicts (#5789) · 35ca04d2
  Lianmin Zheng authored Apr 27, 2025
  
  35ca04d2
- [CI] Tune threshold (#5787) · 3c4e0ee6
  Lianmin Zheng authored Apr 27, 2025
  
  3c4e0ee6
- Revert "Use device_id in dist init to reduce NCCL communicator warmup & creation overhead" (#5786) · 9c088829
  Lianmin Zheng authored Apr 27, 2025
  
  9c088829
- Revert "[fix] fix bench_one_batch_server" (#5785) · 005aad32
  Lianmin Zheng authored Apr 27, 2025
  
  005aad32
- Simplify FA3 tests (#5779) · 4d23ba08
  Lianmin Zheng authored Apr 27, 2025
  
  4d23ba08
- Revert "Revert "fix: import vllm_rotary_embedding error when head_size not in... · 6e313c1b
  Lianmin Zheng authored Apr 27, 2025
```
Revert "Revert "fix: import vllm_rotary_embedding error when head_size not in 64, 128, 256, 512"" (#5777)
```
  6e313c1b