Commits · 021f76e4f49861b2e9ea9ccff06a46d577e3c548 · change / sglang · GitLab

11 Jun, 2025 13 commits
- [Perf] Refactor LoRAManager to eliminate stream syncs and redundant computations (#6994) · 021f76e4
  Lifu Huang authored Jun 11, 2025
  
  021f76e4
- [feat]: Emit fixed-size KV blocks events (#6824) · 777688b8
  Faradawn Yang authored Jun 11, 2025
  
  777688b8
- [FIX]remove redundant code in logits_processor.py (#7079) · 0ca594ed
  Neo authored Jun 12, 2025
  
  0ca594ed
- Support VILA models (#6106) · 31d6dee5
  Zijian authored Jun 12, 2025
  
  31d6dee5
- Fix misusing the "_is_cuda". (#7091) · 02543b54
  sogalin authored Jun 12, 2025
  
  02543b54
- Fix circular import in test_prefix_chunk_info.py (#7097) · 25a6a9aa
  Baizhou Zhang authored Jun 11, 2025
  
  25a6a9aa
- vlm: adapt internvl to VisionAttention (#6870) · 83d87685
  Mick authored Jun 11, 2025
  
  83d87685
- Fix GGuf and add back test_gguf.py (#7067) · 2a5f0100
  Baizhou Zhang authored Jun 10, 2025
  
  2a5f0100
- Clean up docs for server args and sampling parameters (generated by grok) (#7076) · dbdf76ca
  Lianmin Zheng authored Jun 10, 2025
  
  dbdf76ca
- update doc (#7046) · f2a75a66
  Ximingwang-09 authored Jun 11, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  f2a75a66
- Simplify the heuristics for setting --mem-fraction-static (#7054) · 6b12d6a8
  Lianmin Zheng authored Jun 10, 2025
  
  6b12d6a8
- Do not run frontend_reasoning.ipynb to reduce the CI load (#7073) · 0f218731
  Lianmin Zheng authored Jun 10, 2025
  
  0f218731
- Frontend language separate reasoning support (#6031) · 14c18d25
  Yudi Xue authored Jun 10, 2025
  
  14c18d25
10 Jun, 2025 27 commits
- Improve perf tuning docs (#7071) · 90bd3e32
  Lianmin Zheng authored Jun 10, 2025
  
  90bd3e32
- [Feature] Add Logit Bias (#6579) · ca929118
  Brayden Zhong authored Jun 10, 2025
```
Co-authored-by: Cinjon Resnick <cinjon.resnick@gmail.com>
```
  ca929118
- fix arm sgl-kernel link issue (#7066) · 344adb00
  Yineng Zhang authored Jun 10, 2025
  
  344adb00
- Open AI API hidden states (#6716) · b56de8f9
  kyle-pena-kuzco authored Jun 10, 2025
  
  b56de8f9
- chore: update dev docker (#7064) · ce5ee3bd
  Yineng Zhang authored Jun 10, 2025
  
  ce5ee3bd
- Fix missing tool call id if tool call index >0 in streaming tool call output. (#7049) · a0e4d4eb
  Xu Wenqing authored Jun 11, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
  a0e4d4eb
- Revert "Add sanity checks when a test file is not added to CI (#6947)" (#7063) · 2f584455
  Yineng Zhang authored Jun 10, 2025
  
  2f584455
- Add sanity checks when a test file is not added to CI (#6947) · fe55947a
  fzyzcjy authored Jun 11, 2025
  
  fe55947a
- Tiny fix cutlass_mla_get_workspace_size stub incorrect signature (#7057) · 19995dd7
  fzyzcjy authored Jun 11, 2025
  
  19995dd7
- Fix test_lora.py CI (#7061) · 3b014bc1
  Baizhou Zhang authored Jun 10, 2025
  
  3b014bc1
- [fix] libmlx5.so already in base image (#7060) · d7c3e8e9
  Hank Han authored Jun 11, 2025
  
  d7c3e8e9
- [WA] fix output data is nan in CI test "test_moe_eval_accuracy_large.py" (#7021) · 8ea7df61
  kk authored Jun 11, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  8ea7df61
- Minor style fix in cuda_graph_runner.py (#7053) · 4a102a2b
  Lianmin Zheng authored Jun 10, 2025
  
  4a102a2b
- Clean up server_args.py (#7037) · 6406408a
  Lianmin Zheng authored Jun 10, 2025
  
  6406408a
- Fix eagle on AMD (#7051) · 019851d0
  Lianmin Zheng authored Jun 10, 2025
  
  019851d0
- Minor cleanup of fa3 backend (#6999) · 2dae104d
  Lianmin Zheng authored Jun 10, 2025
  
  2dae104d
- fix 24.12 docker (#7045) · cef6655b
  Yineng Zhang authored Jun 10, 2025
  
  cef6655b
- [Docker] Upgrading base image from 24.04 to 24.12 (#7043) · 27196d41
  Swipe4057 authored Jun 10, 2025
  
  27196d41
- Update README.md (#7040) · bb185b0e
  Lianmin Zheng authored Jun 10, 2025
  
  bb185b0e
- chore: bump v0.4.7 (#7038) · 4f723edd
  Yineng Zhang authored Jun 10, 2025
  
  4f723edd
- CPU: map changes from developing branch in sgl-kernel (#6833) · fcde67b0
  YanbingJiang authored Jun 10, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fcde67b0
- Fix fused_moe triton configs (#7029) · 81372f3b
  yudian0504 authored Jun 10, 2025
  
  81372f3b
- [CI] Add CI workflow for sgl-router docker build (#7027) · baa6624d
  Arthur Cheng authored Jun 09, 2025
  
  baa6624d
- Add decode req pool (#6980) · c2b16795
  Byron Hsu authored Jun 09, 2025
  
  c2b16795
- Support both approximate and exact expert distribution collection (#6964) · f6ebba53
  fzyzcjy authored Jun 10, 2025
  
  f6ebba53
- Update default settings for blackwell (#7023) · 6716b417
  Baizhou Zhang authored Jun 09, 2025
  
  6716b417
- chore: update pr test xeon (#7018) · 1c8b42c8
  Yineng Zhang authored Jun 09, 2025
  
  1c8b42c8