Commits · fcde67b016eb6bdc46afbd05e98d962d315b15d1 · change / sglang · GitLab

10 Jun, 2025 1 commit
- CPU: map changes from developing branch in sgl-kernel (#6833) · fcde67b0
  YanbingJiang authored Jun 10, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fcde67b0
09 Jun, 2025 8 commits
- Migrate to assertEqual (#6741) · f40942ad
  Emmanuel Ferdman authored Jun 10, 2025
```
Signed-off-by: Emmanuel Ferdman <emmanuelferdman@gmail.com>
```
  f40942ad
- Simplify prepare_extend_after_decode (#6987) · dc0705a5
  Lianmin Zheng authored Jun 09, 2025
  
  dc0705a5
- Update amd nightly models CI. (#6992) · 3465d7ae
  Sai Enduri authored Jun 09, 2025
  
  3465d7ae
- chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2
  Yineng Zhang authored Jun 09, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
```
  56ccd3c2
- support qwen3 emebedding (#6990) · 451ffe74
  uylnap authored Jun 09, 2025
  
  451ffe74
- Enable more unit tests for AMD CI. (#6983) · 2c186425
  Sai Enduri authored Jun 08, 2025
  
  2c186425
- Fix triton sliding window test case (#6981) · 9ecb1856
  Lianmin Zheng authored Jun 08, 2025
  
  9ecb1856
- Fix draft extend ut stability with flush cache (#6979) · cc74499d
  Ke Bao authored Jun 09, 2025
  
  cc74499d
08 Jun, 2025 3 commits
- Sync cuda graph runners (#6976) · 0c1f03a2
  Lianmin Zheng authored Jun 08, 2025
  
  0c1f03a2
- Fix CI and triton moe Configs (#6974) · 20d3ad3b
  Lianmin Zheng authored Jun 08, 2025
  
  20d3ad3b
- [AMD] Add more tests to per-commit-amd (#6926) · 47402883
  Hubert Lu authored Jun 08, 2025
  
  47402883
06 Jun, 2025 1 commit
- AITER backend extension and workload optimizations (#6838) · b819381f
  HAI authored Jun 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  b819381f
05 Jun, 2025 5 commits
- [CPU] enable CI for PRs, add Dockerfile and auto build task (#6458) · 562f279a
  Zaili Wang authored Jun 06, 2025
```
Co-authored-by: diwei sun <diwei.sun@intel.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  562f279a
- bugfix(OAI): Fix image_data processing for jinja chat templates (#6877) · 8b247489
  Chang Su authored Jun 05, 2025
  
  8b247489
- Support layerwise rebalancing experts (#6851) · 0de5e7d4
  fzyzcjy authored Jun 05, 2025
  
  0de5e7d4
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
- Support LoRA in TestOpenAIVisionServer and fix fused kv_proj loading bug. (#6861) · 4474eaf5
  Lifu Huang authored Jun 04, 2025
  
  4474eaf5
04 Jun, 2025 4 commits
- feat: add dp-rank to KV events (#6852) · f0f84975
  ishandhanani authored Jun 04, 2025
  
  f0f84975
- Decoder-only Scoring API (#6460) · 3f1e4339
  Chanh Nguyen authored Jun 04, 2025
```
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
```
  3f1e4339
- [Refactor] Multimodal data processing for VLM (#6659) · cf9815ba
  Xinyuan Tong authored Jun 04, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  cf9815ba
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
03 Jun, 2025 1 commit
- Add CPU optimized kernels for topk and rope fusions (#6456) · ff00895c
  jianan-gu authored Jun 03, 2025
  
  ff00895c
02 Jun, 2025 1 commit
- Add draft extend CUDA graph for flashinfer backend (#6805) · a2cb5913
  Ke Bao authored Jun 02, 2025
  
  a2cb5913
01 Jun, 2025 1 commit
- Update CI tests for Llama4 models (#6421) · c6a0cacc
  Ravi Theja authored Jun 01, 2025
  
  c6a0cacc
31 May, 2025 5 commits
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
- ci: relax test_function_call_required (#6786) · e39bca07
  Chang Su authored May 30, 2025
  
  e39bca07
- Temporarily lower mmlu threshold for triton sliding window backend (#6785) · a2bb8565
  Jianan Ji authored May 30, 2025
  
  a2bb8565
- feat(tool call): Enhance Llama32Detector for improved JSON parsing in non-stream (#6784) · f18b068f
  Chang Su authored May 30, 2025
  
  f18b068f
- update llama4 chat template and pythonic parser (#6679) · 4fac524b
  Chao Yang authored May 30, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  4fac524b
30 May, 2025 1 commit
- Support sliding window in triton backend (#6509) · 22630ca2
  Jianan Ji authored May 30, 2025
  
  22630ca2
29 May, 2025 2 commits
- refactor(tool call): Fix BaseFormatDetector tool_index issue and refactor... · c673727e
  Chang Su authored May 29, 2025
```
refactor(tool call): Fix BaseFormatDetector tool_index issue and refactor `parse_streaming_increment` (#6715)
```
  c673727e
- Fix PP for Qwen3 MoE (#6709) · e06b0761
  iLeGend authored May 29, 2025
  
  e06b0761
28 May, 2025 3 commits
- [CI] Fix setup of disaggregation with different tp (#6706) · d63e76f7
  shangmingc authored May 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d63e76f7
- [CI] Fix flaky pp single node test (#6689) · c25231c6
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  c25231c6
- Update amd docker and nightly models. (#6687) · f4a8987f
  Sai Enduri authored May 28, 2025
  
  f4a8987f
27 May, 2025 4 commits
- feat: Add warnings for invalid tool_choice and UTs (#6582) · 41ba767f
  Chang Su authored May 27, 2025
  
  41ba767f
- Add batch test for draft extend (#6672) · f127355a
  Ke Bao authored May 28, 2025
  
  f127355a
- Support gathering expert distribution details (#6665) · 87068b5c
  fzyzcjy authored May 28, 2025
  
  87068b5c
- [CI] update verlengine ci to 4-gpu test (#6007) · 2103b806
  Junrong Lin authored May 28, 2025
  
  2103b806