Commits · 3774f078250d1cd5f8a0a18f80bba8d03d937db1 · change / sglang

19 Jun, 2025 1 commit
- Multi-Stage Awake: Support Resume and Pause KV Cache and Weights separately (#7099) · 3774f078
  Stefan He authored Jun 19, 2025
  
  3774f078
18 Jun, 2025 2 commits
- Add more refactored openai test & in CI (#7284) · ffd1a26e
  Jinn authored Jun 18, 2025
  
  ffd1a26e
- Update python API of activation, topk, norm and rope and remove vllm dependency (#6614) · 094c116f
  YanbingJiang authored Jun 18, 2025
```
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>
```
  094c116f
16 Jun, 2025 1 commit
- Feat/support rerank (#6058) · e30ef368
  woodx authored Jun 17, 2025
  
  e30ef368
14 Jun, 2025 2 commits
- Improve test cases for eagle infer (#7173) · ba589b88
  Lianmin Zheng authored Jun 13, 2025
  
  ba589b88
- Split the eagle test into two files (#7170) · 0fc3d992
  Lianmin Zheng authored Jun 13, 2025
  
  0fc3d992
11 Jun, 2025 1 commit
- Fix GGuf and add back test_gguf.py (#7067) · 2a5f0100
  Baizhou Zhang authored Jun 10, 2025
  
  2a5f0100
10 Jun, 2025 3 commits
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
- Revert "Add sanity checks when a test file is not added to CI (#6947)" (#7063) · 2f584455
  Yineng Zhang authored Jun 10, 2025
  
  2f584455
- Add sanity checks when a test file is not added to CI (#6947) · fe55947a
  fzyzcjy authored Jun 11, 2025
  
  fe55947a
09 Jun, 2025 2 commits

chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2

Yineng Zhang authored Jun 09, 2025


Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>

56ccd3c2

Enable more unit tests for AMD CI. (#6983) · 2c186425
Sai Enduri authored Jun 08, 2025

2c186425

08 Jun, 2025 1 commit
- [AMD] Add more tests to per-commit-amd (#6926) · 47402883
  Hubert Lu authored Jun 08, 2025
  
  47402883
05 Jun, 2025 2 commits
- [CPU] enable CI for PRs, add Dockerfile and auto build task (#6458) · 562f279a
  Zaili Wang authored Jun 06, 2025
```
Co-authored-by: diwei sun <diwei.sun@intel.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  562f279a
- bugfix(OAI): Fix image_data processing for jinja chat templates (#6877) · 8b247489
  Chang Su authored Jun 05, 2025
  
  8b247489
04 Jun, 2025 1 commit
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
31 May, 2025 1 commit
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
30 May, 2025 1 commit
- Support sliding window in triton backend (#6509) · 22630ca2
  Jianan Ji authored May 30, 2025
  
  22630ca2
27 May, 2025 2 commits
- feat: Add warnings for invalid tool_choice and UTs (#6582) · 41ba767f
  Chang Su authored May 27, 2025
  
  41ba767f
- [CI] update verlengine ci to 4-gpu test (#6007) · 2103b806
  Junrong Lin authored May 28, 2025
  
  2103b806
25 May, 2025 1 commit
- Refactor vlm embedding routine to use precomputed feature (#6543) · 681fdc26
  Xinyuan Tong authored May 24, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  681fdc26
24 May, 2025 1 commit
- feat(Tool Calling): Support `required` and specific function mode (#6550) · ed0c3035
  Chang Su authored May 23, 2025
  
  ed0c3035
23 May, 2025 1 commit
- [PD] support spec decode (#6507) · d2e0881a
  Byron Hsu authored May 23, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d2e0881a
22 May, 2025 1 commit
- chore: upgrade sgl-kernel v0.1.4 (#6532) · 0b07c4a9
  Yineng Zhang authored May 22, 2025
  
  0b07c4a9
18 May, 2025 1 commit
- Add 4-GPU runner tests and split existing tests (#6383) · f11481b9
  fzyzcjy authored May 19, 2025
  
  f11481b9
14 May, 2025 1 commit
- Enable unit tests for AMD CI. (#6283) · 73eb67c0
  Sai Enduri authored May 14, 2025
  
  73eb67c0
12 May, 2025 3 commits
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- [CI] Re-enable pd disaggregation test (#6231) · 3ee40ff9
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ee40ff9
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 3 commits
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- [CI] Disabled deepep tests temporarily because it takes too much time. (#6186) · 17c36c55
  Lianmin Zheng authored May 10, 2025
  
  17c36c55
- [PD] Add simple unit test for disaggregation feature (#5654) · 31d1f6e7
  shangmingc authored May 11, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  31d1f6e7
10 May, 2025 1 commit
- Revert "feat: add thinking_budget (#6089)" (#6181) · 66fc63d6
  Yineng Zhang authored May 10, 2025
  
  66fc63d6
09 May, 2025 1 commit
- feat: add thinking_budget (#6089) · 63484f9f
  thyecust authored May 09, 2025
  
  63484f9f
08 May, 2025 1 commit
- Clean up fa3 test from 8 gpus (#6105) · 24c13ca9
  Stefan He authored May 07, 2025
  
  24c13ca9
07 May, 2025 1 commit
- Add DeepEP to CI PR Test (#5655) · 8a828666
  Jinyan Chen authored May 07, 2025
```
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
```
  8a828666
06 May, 2025 1 commit
- [Fix] Fix and rename flashmla CI test (#6045) · bdd17998
  Baizhou Zhang authored May 06, 2025
  
  bdd17998
05 May, 2025 1 commit
- [Test] Add flashmla attention backend test (#5587) · b8559764
  Huapeng Zhou authored May 06, 2025
  
  b8559764
01 May, 2025 2 commits
- fix: correct stream response when enable_thinking is set to false (#5881) · 256c4c25
  mlmz authored May 01, 2025
  
  256c4c25
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec