Commits · 2b06484bd198cf090d7153e7aad5daffa8250355 · change / sglang · GitLab

30 Apr, 2025 2 commits
- feat: support pythonic tool call and index in tool call streaming (#5725) · 2b06484b
  Chang Su authored Apr 29, 2025
  
  2b06484b
- [fix] relax mem_fraction_static for h200 (#5893) · e4b6133b
  JieXin Liang authored Apr 30, 2025
```
Co-authored-by: alcanerian <alcanerian@gmail.com>
```
  e4b6133b
29 Apr, 2025 18 commits
- Auto set draft model path for MTP (#5793) · dd408ee4
  Ke Bao authored Apr 30, 2025
  
  dd408ee4
- [CI] Add test_function_calling.py to run_suite.py (#5896) · 9419e75d
  Chang Su authored Apr 29, 2025
  
  9419e75d
- [FEATURE] Enhance platform compatibility for ARM (#5746) · 2c7dbb7c
  Johnny authored Apr 30, 2025
  
  2c7dbb7c
- chore: update CODEOWNERS (#5895) · 9a62191b
  Yineng Zhang authored Apr 29, 2025
  
  9a62191b
- [Doc] Tables instead of bulletpoints for sampling doc (#5841) · ae523675
  simveit authored Apr 29, 2025
  
  ae523675
- [Docs] Update docs for Qwen3 and Qwen3MoE (#5836) · 5c08aa49
  Adarsh Shirawalmath authored Apr 30, 2025
  
  5c08aa49
- chore: update Dockerfile (#5894) · f4c191a7
  Yineng Zhang authored Apr 29, 2025
  
  f4c191a7
- [fix]: PyO3 macOS linking and consolidate on tracing for logging · 771669cb
  Simo Lin authored Apr 29, 2025
  
  771669cb
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
- Add A800 fused moe config for qwen3 30b (#5880) · 91dda4cd
  lambert0312 authored Apr 29, 2025
  
  91dda4cd
- [Fix] Fix a bug for flashmla to run R1 model (#5875) · 8e5a6d34
  pengcuo authored Apr 29, 2025
```
Co-authored-by: pengcuo <dgpengcuo@gmail.com>
```
  8e5a6d34
- Add qwen3 30b fused moe config (#5859) · 8465f035
  XinyuanTong authored Apr 29, 2025
  
  8465f035
- Feat: support cuda graph for LoRA (#4115) · 8c0cfca8
  Qiaolin Yu authored Apr 29, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  8c0cfca8
- [Feature] support auto chat template (#4949) · 2c3ea294
  woodx authored Apr 29, 2025
  
  2c3ea294
- cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) · 5bb0accb
  Xiaoyu Zhang authored Apr 29, 2025
  
  5bb0accb
- Cutlass MLA decode - fix dtype error (#5868) · 8d463fe3
  Trevor Morris authored Apr 28, 2025
  
  8d463fe3
- [CI] tune the test order to warmup the server (#5860) · 26fc32d1
  Lianmin Zheng authored Apr 28, 2025
  
  26fc32d1
- simplify fused_moe config logging (#5801) · 1cc32603
  Xiaoyu Zhang authored Apr 29, 2025
  
  1cc32603
28 Apr, 2025 20 commits
- Support `max_completion_tokens` for OpenAIChatCompletions (#5857) · 05ee2192
  Chang Su authored Apr 28, 2025
  
  05ee2192
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- feat: update is_fa3_default_architecture (#5854) · 663037a7
  Yineng Zhang authored Apr 28, 2025
  
  663037a7
- [Fix] Missing bootstrap_port field (#5823) · f4a9f60c
  XTY authored Apr 29, 2025
  
  f4a9f60c
- [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) · ee71ed8a
  PGFLMG authored Apr 29, 2025
```
Co-authored-by: sighingnow <sighingnow@gmail.com>
```
  ee71ed8a
- ROCm: update AITER (#5816) · d364b9b0
  HAI authored Apr 28, 2025
  
  d364b9b0
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- feat: Add fused moe triton config for qwen3-30b-fp8 moe on h20 (#5850) · d73ddeb1
  JiLi authored Apr 29, 2025
  
  d73ddeb1
- [Doc] Recover history of server_arguments.md (#5851) · f48b007c
  Baizhou Zhang authored Apr 28, 2025
  
  f48b007c
- [config] qwen3moe_tune_h20 fp8 tp4 (#5846) · 74cb12a8
  ybyang authored Apr 29, 2025
  
  74cb12a8
- [PD] support pd fake transfer for warmup (#5726) · c6c62640
  ybyang authored Apr 29, 2025
  
  c6c62640
- feat: Add fused moe triton config for qwen3bf16 moe on h20 (#5839) · 92ab0a20
  yhyang201 authored Apr 29, 2025
  
  92ab0a20
- fused moe triton tuning script support qwen3 (#5842) · e132cba2
  Xiaoyu Zhang authored Apr 29, 2025
  
  e132cba2
- feat: Add fused moe triton config for qwen3 moe on h100 (#5833) · 0045f4b2
  XinyuanTong authored Apr 28, 2025
  
  0045f4b2
- fix: fix the error where the content is None when reasoning and tool … (#5838) · 8601300b
  mlmz authored Apr 28, 2025
  
  8601300b
- Feat: add support for thinking mode via chat_template_kwargs.enable_t… (#5551) · 6fa6f38e
  mlmz authored Apr 28, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  6fa6f38e
- Revert "Tiny refactor DefaultModelLoader.Source" (#5825) · 693723d1
  Lianmin Zheng authored Apr 28, 2025
  
  693723d1
- [Docs] Replace lists with tables for cleanup and readability in server_arguments (#5276) · 966eb908
  Michael Yao authored Apr 28, 2025
  
  966eb908
- Tiny refactor DefaultModelLoader.Source (#5482) · 644ed409
  fzyzcjy authored Apr 28, 2025
  
  644ed409