Commits · ae523675e547009d3c09bd0220944ca542bda3cb · change / sglang

"vscode:/vscode.git/clone" did not exist on "afb2291b22a6913d7f1ebb390e6fc59f55d92928"

29 Apr, 2025 14 commits
- [Doc] Tables instead of bulletpoints for sampling doc (#5841) · ae523675
  simveit authored Apr 29, 2025
  
  ae523675
- [Docs] Update docs for Qwen3 and Qwen3MoE (#5836) · 5c08aa49
  Adarsh Shirawalmath authored Apr 30, 2025
  
  5c08aa49
- chore: update Dockerfile (#5894) · f4c191a7
  Yineng Zhang authored Apr 29, 2025
  
  f4c191a7
- [fix]: PyO3 macOS linking and consolidate on tracing for logging · 771669cb
  Simo Lin authored Apr 29, 2025
  
  771669cb
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
- Add A800 fused moe config for qwen3 30b (#5880) · 91dda4cd
  lambert0312 authored Apr 29, 2025
  
  91dda4cd
- [Fix] Fix a bug for flashmla to run R1 model (#5875) · 8e5a6d34
  pengcuo authored Apr 29, 2025
```
Co-authored-by: pengcuo <dgpengcuo@gmail.com>
```
  8e5a6d34
- Add qwen3 30b fused moe config (#5859) · 8465f035
  XinyuanTong authored Apr 29, 2025
  
  8465f035
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
- [Feature] support auto chat template (#4949) · 2c3ea294
  woodx authored Apr 29, 2025
  
  2c3ea294
- cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) · 5bb0accb
  Xiaoyu Zhang authored Apr 29, 2025
  
  5bb0accb
- Cutlass MLA decode - fix dtype error (#5868) · 8d463fe3
  Trevor Morris authored Apr 28, 2025
  
  8d463fe3
- [CI] tune the test order to warmup the server (#5860) · 26fc32d1
  Lianmin Zheng authored Apr 28, 2025
  
  26fc32d1
- simplify fused_moe config logging (#5801) · 1cc32603
  Xiaoyu Zhang authored Apr 29, 2025
  
  1cc32603
28 Apr, 2025 26 commits
- Support `max_completion_tokens` for OpenAIChatCompletions (#5857) · 05ee2192
  Chang Su authored Apr 28, 2025
  
  05ee2192
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- feat: update is_fa3_default_architecture (#5854) · 663037a7
  Yineng Zhang authored Apr 28, 2025
  
  663037a7
- [Fix] Missing bootstrap_port field (#5823) · f4a9f60c
  XTY authored Apr 29, 2025
  
  f4a9f60c
- [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) · ee71ed8a
  PGFLMG authored Apr 29, 2025
```
Co-authored-by: sighingnow <sighingnow@gmail.com>
```
  ee71ed8a
- ROCm: update AITER (#5816) · d364b9b0
  HAI authored Apr 28, 2025
  
  d364b9b0
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- feat: Add fused moe triton config for qwen3-30b-fp8 moe on h20 (#5850) · d73ddeb1
  JiLi authored Apr 29, 2025
  
  d73ddeb1
- [Doc] Recover history of server_arguments.md (#5851) · f48b007c
  Baizhou Zhang authored Apr 28, 2025
  
  f48b007c
- [config] qwen3moe_tune_h20 fp8 tp4 (#5846) · 74cb12a8
  ybyang authored Apr 29, 2025
  
  74cb12a8
- [PD] support pd fake transfer for warmup (#5726) · c6c62640
  ybyang authored Apr 29, 2025
  
  c6c62640
- feat: Add fused moe triton config for qwen3bf16 moe on h20 (#5839) · 92ab0a20
  yhyang201 authored Apr 29, 2025
  
  92ab0a20
- fused moe triton tuning script support qwen3 (#5842) · e132cba2
  Xiaoyu Zhang authored Apr 29, 2025
  
  e132cba2
- feat: Add fused moe triton config for qwen3 moe on h100 (#5833) · 0045f4b2
  XinyuanTong authored Apr 28, 2025
  
  0045f4b2
- fix: fix the error where the content is None when reasoning and tool … (#5838) · 8601300b
  mlmz authored Apr 28, 2025
  
  8601300b
- Feat: add support for thinking mode via chat_template_kwargs.enable_t… (#5551) · 6fa6f38e
  mlmz authored Apr 28, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  6fa6f38e
- Revert "Tiny refactor DefaultModelLoader.Source" (#5825) · 693723d1
  Lianmin Zheng authored Apr 28, 2025
  
  693723d1
- [Docs] Replace lists with tables for cleanup and readability in server_arguments (#5276) · 966eb908
  Michael Yao authored Apr 28, 2025
  
  966eb908
- Tiny refactor DefaultModelLoader.Source (#5482) · 644ed409
  fzyzcjy authored Apr 28, 2025
  
  644ed409
- Turn on overlap scheduler for multimodal models (#5771) · 3029889c
  Lianmin Zheng authored Apr 27, 2025
  
  3029889c
- Add a doc to fix sgl-kernel build link error in py39 with ccache (#5809) · ef15dcda
  Xiaoyu Zhang authored Apr 28, 2025
  
  ef15dcda
- Dockerfile.dev pip scikit_build_core (#5807) · ad4df307
  Xiaoyu Zhang authored Apr 28, 2025
  
  ad4df307
- chore: upgrade sgl-kernel 0.1.0 (#5690) · 41ac0c6d
  Yineng Zhang authored Apr 27, 2025
  
  41ac0c6d
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
- Improve overlap scheduling (#5788) · 40d9b8ac
  Liangsheng Yin authored Apr 28, 2025
  
  40d9b8ac