Commits · c2b7ddca496189d9cdc69aa0975fa3c6877e9538 · change / sglang

16 May, 2025 2 commits
- [Minor] cleanup unused imports (#6358) · c2b7ddca
  Lianmin Zheng authored May 16, 2025
  
  c2b7ddca
- Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136) · f19a9204
  Yury Sulsky authored May 16, 2025
```
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
```
  f19a9204
15 May, 2025 3 commits

Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216) · fb4959b2
Chunyuan WU authored May 16, 2025
```
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
fb4959b2

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb

quinnrong94 authored May 15, 2025


Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>

2e4babdb

[fix][RL] Remove the incorrect barrier in init_weights_update_group (#5914) · 44a3783d
Zilin Zhu authored May 15, 2025

44a3783d

14 May, 2025 1 commit
- Enable unit tests for AMD CI. (#6283) · 73eb67c0
  Sai Enduri authored May 14, 2025
  
  73eb67c0
13 May, 2025 2 commits
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
- Skip the flaky test_stateful_custom_logit_processor (#6251) · ac2324c1
  Lianmin Zheng authored May 12, 2025
  
  ac2324c1
12 May, 2025 7 commits
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- Update AMD nightly deps. (#6241) · 983c663d
  Sai Enduri authored May 12, 2025
  
  983c663d
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- [CI] Re-enable pd disaggregation test (#6231) · 3ee40ff9
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ee40ff9
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 10 commits
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- Handle empty input string for embedding models (#5621) · 41a645f5
  Ravi Theja authored May 11, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  41a645f5
- [CI] Disabled deepep tests temporarily because it takes too much time. (#6186) · 17c36c55
  Lianmin Zheng authored May 10, 2025
  
  17c36c55
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
- Remove duplicate IO Struct test (#6180) · a823c6e8
  Emmanuel Ferdman authored May 11, 2025
```
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
```
  a823c6e8
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
- Fix request abortion (#6184) · de167cf5
  Lianmin Zheng authored May 10, 2025
  
  de167cf5
- Added async_encode method to Engine (#4701) · 03dd785c
  Steven Shimizu authored May 10, 2025
  
  03dd785c
10 May, 2025 2 commits
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
09 May, 2025 1 commit
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
08 May, 2025 5 commits
- Change AMD test threshold (#6091) · a05bd83a
  fzyzcjy authored May 08, 2025
  
  a05bd83a
- Tiny refactor ModelConfig.from_server_args (#5219) · b6cf3532
  fzyzcjy authored May 08, 2025
  
  b6cf3532
- [CI]Add performance CI for VLM (#6038) · e88dd482
  XinyuanTong authored May 07, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  e88dd482
- Deferring 8 GPU test (#6102) · 9bddf1c8
  Cheng Wan authored May 07, 2025
  
  9bddf1c8
- Clean up fa3 test from 8 gpus (#6105) · 24c13ca9
  Stefan He authored May 07, 2025
  
  24c13ca9
07 May, 2025 1 commit
- Add DeepEP to CI PR Test (#5655) · 8a828666
  Jinyan Chen authored May 07, 2025
```
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
```
  8a828666
06 May, 2025 1 commit
- [Fix] Fix and rename flashmla CI test (#6045) · bdd17998
  Baizhou Zhang authored May 06, 2025
  
  bdd17998
05 May, 2025 1 commit
- [Test] Add flashmla attention backend test (#5587) · b8559764
  Huapeng Zhou authored May 06, 2025
  
  b8559764
04 May, 2025 1 commit
- Fix flaky issues of lora and add multi batch tests (#5957) · 3042f1da
  Qiaolin Yu authored May 04, 2025
  
  3042f1da
02 May, 2025 2 commits
- Support InternVL3 (#5350) · 3409aaab
  xm:D authored May 02, 2025
```
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  3409aaab
- Add 1 gpu perf and 2 gpu accuracy tests for AMD MI300x CI. (#5960) · 73bc1d00
  Sai Enduri authored May 01, 2025
  
  73bc1d00
01 May, 2025 1 commit
- Properly return error response in vertex_generate HTTP endpoint (#5956) · d33955d2
  KCFindstr authored May 01, 2025
  
  d33955d2