Commits · b06215daed08ebbe3d57eb2858fcbc532f47adc1 · change / sglang

"vscode:/vscode.git/clone" did not exist on "c06170cc8e324f4fe6a0c26b57d09e8c958e11bc"

19 May, 2025 3 commits
- [Metrics] Add KV events publishing (#6098) · 7adf245b
  Trevor Morris authored May 19, 2025
  
  7adf245b
- Fix throughput threshold for amd ci test (#6414) · 299fd22f
  Baizhou Zhang authored May 19, 2025
  
  299fd22f
- Implement `return_hidden_states` for the OpenAI API (#6137) · 4f39bcf7
  kyle-pena-kuzco authored May 19, 2025
  
  4f39bcf7
18 May, 2025 5 commits
- Add fp8 shared_expert kernel for CPU in sgl-kernel and add UT (#6339) · 5dd62c3a
  Chunyuan WU authored May 19, 2025
```
Co-authored-by: Jiang, Yanbing <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  5dd62c3a
- Add 4-GPU runner tests and split existing tests (#6383) · f11481b9
  fzyzcjy authored May 19, 2025
  
  f11481b9
- Add pipeline parallelism for Qwen2 and Qwen3 Model (#6250) · 11553c1a
  libra authored May 18, 2025
  
  11553c1a
- refactor: minor refactors regarding multimodal processing (#6187) · 01dd39ba
  Mick authored May 18, 2025
  
  01dd39ba
- Support custom DeepEP tuning config (#6257) · fd08c048
  fzyzcjy authored May 18, 2025
  
  fd08c048
17 May, 2025 2 commits
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a
- model(vlm): mistral 3.1 (#5099) · 64825b83
  Kiv Chen authored May 16, 2025
```
Co-authored-by: KivenChen <sleigh-queue-0y@icloud.com>
```
  64825b83
16 May, 2025 2 commits
- [Minor] cleanup unused imports (#6358) · c2b7ddca
  Lianmin Zheng authored May 16, 2025
  
  c2b7ddca
- Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136) · f19a9204
  Yury Sulsky authored May 16, 2025
```
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
```
  f19a9204
15 May, 2025 3 commits

Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216) · fb4959b2
Chunyuan WU authored May 16, 2025
```
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
fb4959b2

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb

quinnrong94 authored May 15, 2025


Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>

2e4babdb

[fix][RL] Remove the incorrect barrier in init_weights_update_group (#5914) · 44a3783d
Zilin Zhu authored May 15, 2025

44a3783d

14 May, 2025 1 commit
- Enable unit tests for AMD CI. (#6283) · 73eb67c0
  Sai Enduri authored May 14, 2025
  
  73eb67c0
13 May, 2025 2 commits
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
- Skip the flaky test_stateful_custom_logit_processor (#6251) · ac2324c1
  Lianmin Zheng authored May 12, 2025
  
  ac2324c1
12 May, 2025 7 commits
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- Update AMD nightly deps. (#6241) · 983c663d
  Sai Enduri authored May 12, 2025
  
  983c663d
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- [CI] Re-enable pd disaggregation test (#6231) · 3ee40ff9
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ee40ff9
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 10 commits
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- Improve structured outputs: fix race condition, server crash, metrics and style (#6188) · 01bdbf7f
  Lianmin Zheng authored May 11, 2025
  
  01bdbf7f
- Handle empty input string for embedding models (#5621) · 41a645f5
  Ravi Theja authored May 11, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  41a645f5
- [CI] Disabled deepep tests temporarily because it takes too much time. (#6186) · 17c36c55
  Lianmin Zheng authored May 10, 2025
  
  17c36c55
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
- Remove duplicate IO Struct test (#6180) · a823c6e8
  Emmanuel Ferdman authored May 11, 2025
```
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
```
  a823c6e8
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
- Fix request abortion (#6184) · de167cf5
  Lianmin Zheng authored May 10, 2025
  
  de167cf5
- Added async_encode method to Engine (#4701) · 03dd785c
  Steven Shimizu authored May 10, 2025
  
  03dd785c
10 May, 2025 2 commits
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
- Fix and Clean up chat-template requirement for VLM (#6114) · 9d8ec2e6
  XinyuanTong authored May 10, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  9d8ec2e6
09 May, 2025 1 commit
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
08 May, 2025 2 commits
- Change AMD test threshold (#6091) · a05bd83a
  fzyzcjy authored May 08, 2025
  
  a05bd83a
- Tiny refactor ModelConfig.from_server_args (#5219) · b6cf3532
  fzyzcjy authored May 08, 2025
  
  b6cf3532