Commits · dcae1fb2cd2def2a2eb4919c21f74e91d888d161 · change / sglang · GitLab

28 Apr, 2025 19 commits
- chore: bump v0.4.6.post1 (#5845) · dcae1fb2
  Yineng Zhang authored Apr 28, 2025
  
  dcae1fb2
- add fused moe config for qwen3moe fp8/bf16 (#5849) · a0251a3f
  Yi Zhang authored Apr 29, 2025
  
  a0251a3f
- feat: update is_fa3_default_architecture (#5854) · 663037a7
  Yineng Zhang authored Apr 28, 2025
  
  663037a7
- [Fix] Missing bootstrap_port field (#5823) · f4a9f60c
  XTY authored Apr 29, 2025
  
  f4a9f60c
- ROCm: update AITER (#5816) · d364b9b0
  HAI authored Apr 28, 2025
  
  d364b9b0
- [CI] test chunked prefill more (#5798) · 849c83a0
  Lianmin Zheng authored Apr 28, 2025
  
  849c83a0
- feat: Add fused moe triton config for qwen3-30b-fp8 moe on h20 (#5850) · d73ddeb1
  JiLi authored Apr 29, 2025
  
  d73ddeb1
- [config] qwen3moe_tune_h20 fp8 tp4 (#5846) · 74cb12a8
  ybyang authored Apr 29, 2025
  
  74cb12a8
- [PD] support pd fake transfer for warmup (#5726) · c6c62640
  ybyang authored Apr 29, 2025
  
  c6c62640
- feat: Add fused moe triton config for qwen3bf16 moe on h20 (#5839) · 92ab0a20
  yhyang201 authored Apr 29, 2025
  
  92ab0a20
- feat: Add fused moe triton config for qwen3 moe on h100 (#5833) · 0045f4b2
  XinyuanTong authored Apr 28, 2025
  
  0045f4b2
- fix: fix the error where the content is None when reasoning and tool … (#5838) · 8601300b
  mlmz authored Apr 28, 2025
  
  8601300b
- Feat: add support for thinking mode via chat_template_kwargs.enable_t… (#5551) · 6fa6f38e
  mlmz authored Apr 28, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  6fa6f38e
- Revert "Tiny refactor DefaultModelLoader.Source" (#5825) · 693723d1
  Lianmin Zheng authored Apr 28, 2025
  
  693723d1
- Tiny refactor DefaultModelLoader.Source (#5482) · 644ed409
  fzyzcjy authored Apr 28, 2025
  
  644ed409
- Turn on overlap scheduler for multimodal models (#5771) · 3029889c
  Lianmin Zheng authored Apr 27, 2025
  
  3029889c
- chore: upgrade sgl-kernel 0.1.0 (#5690) · 41ac0c6d
  Yineng Zhang authored Apr 27, 2025
  
  41ac0c6d
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4
- Improve overlap scheduling (#5788) · 40d9b8ac
  Liangsheng Yin authored Apr 28, 2025
  
  40d9b8ac
27 Apr, 2025 21 commits
- [CI] Improve github summary & enable fa3 for more models (#5796) · daed453e
  Lianmin Zheng authored Apr 27, 2025
  
  daed453e
- Release v0.4.6 (#5795) · 84022c0e
  Baizhou Zhang authored Apr 27, 2025
  
  84022c0e
- [CI] Fix test case (#5790) · a38f6932
  Lianmin Zheng authored Apr 27, 2025
  
  a38f6932
- [PD]Reduce kv transfer threads (#5791) · beb65c74
  Liangsheng Yin authored Apr 27, 2025
  
  beb65c74
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
- [CI] fix port conflicts (#5789) · 35ca04d2
  Lianmin Zheng authored Apr 27, 2025
  
  35ca04d2
- Revert "Use device_id in dist init to reduce NCCL communicator warmup & creation overhead" (#5786) · 9c088829
  Lianmin Zheng authored Apr 27, 2025
  
  9c088829
- Revert "[fix] fix bench_one_batch_server" (#5785) · 005aad32
  Lianmin Zheng authored Apr 27, 2025
  
  005aad32
- Revert "Revert "fix: import vllm_rotary_embedding error when head_size not in... · 6e313c1b
  Lianmin Zheng authored Apr 27, 2025
```
Revert "Revert "fix: import vllm_rotary_embedding error when head_size not in 64, 128, 256, 512"" (#5777)
```
  6e313c1b
- Revert "fix: import vllm_rotary_embedding error when head_size not in 64, 128, 256, 512" (#5772) · 8ba31330
  Lianmin Zheng authored Apr 26, 2025
  
  8ba31330
- add switch to disable open api doc (#3744) · 02102063
  zhanweidu authored Apr 27, 2025
```
Signed-off-by: congcongke <zhanweidu@163.com>
```
  02102063
- Add memory_saver check (#4986) · 7e944246
  Kebe authored Apr 27, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  7e944246
- Use sgl-kernel sgl_per_token_group_quant_int8 (#4971) · a086a113
  lambert0312 authored Apr 27, 2025
  
  a086a113
- update llguidance to 0.7.11; adds StructTag (#4870) · bdbe5f81
  Michał Moskal authored Apr 26, 2025
  
  bdbe5f81
- fix(srt): check if sample_indices is not None before usage. (#5633) · 9ad28f63
  aoshen524 authored Apr 26, 2025
  
  9ad28f63
- Handle JSONDecodeError while processing request data (#5599) · d7b1ce65
  yan97ao authored Apr 27, 2025
  
  d7b1ce65
- [misc] more decode step log for batch_one_batch (#5565) · f55933e1
  JieXin Liang authored Apr 27, 2025
  
  f55933e1
- Add Llama 4 to FA3 test (#5509) · 408ba022
  Stefan He authored Apr 26, 2025
  
  408ba022
- fix: Use `is not None` instead of `!= None` for None checks. (#5687) · 094891c0
  vzed authored Apr 26, 2025
  
  094891c0
- support for the DeepSeek model by enabling streaming response parsing (#5592) · a21ef363
  Frankey_8080 authored Apr 27, 2025
  
  a21ef363
- [fix] fix bench_one_batch_server (#5607) · 3c4dc38a
  JieXin Liang authored Apr 27, 2025
  
  3c4dc38a