Commits · b89111d69b35ef462fa615e982ecd3cfa9d95c7f · change / sglang · GitLab

26 Oct, 2025 24 commits
- add gitignore for claude code and serena mcp (#12166) · b89111d6
  Simo Lin authored Oct 26, 2025
  
  b89111d6
- transfer mrope_position_delta to device when first running (#11047) · 0b3b3e9a
  ash-sigh authored Oct 27, 2025
  
  0b3b3e9a
- Avoid using flashinfer_allreduce_fusion when dp attention is enabled. (#11632) · a1d5bc4c
  Elfie Guo authored Oct 26, 2025
  
  a1d5bc4c
- model: support NVILA and NVILA Lite (#10399) · a8023891
  Zijian Zhang authored Oct 27, 2025
  
  a8023891
- Support DeepGEMM for deterministic inference (#12142) · 0103f374
  fzyzcjy authored Oct 26, 2025
  
  0103f374
- [Fix] fix allreduce bug in Piecewise Graph (#12106) · 96a5a949
  zyksir authored Oct 26, 2025
  
  96a5a949
- Fix ITL metrics when using openai endpoint with spec (#12156) · ea385ae8
  Liangsheng Yin authored Oct 26, 2025
  
  ea385ae8
- [router] centralize mcp tool args handling (#12155) · 9e949e58
  Simo Lin authored Oct 26, 2025
  
  9e949e58
- [router][grpc] Fix tool call id in `parse_json_schema_response` (#12152) · 6dbb569b
  Chang Su authored Oct 26, 2025
  
  6dbb569b
- Do not use `MagicMock` to mock `server_args` in tests (#12154) · 5994e6c3
  Liangsheng Yin authored Oct 26, 2025
  
  5994e6c3
- [HiCache]Page head layout IO kernel (#11615) · 3e6281d0
  huangtingwei authored Oct 26, 2025
  
  3e6281d0
- [quantization] AWQ Marlin doesn't work when dtype is bfloat16 (#11494) · 6371f7af
  Kai-Hsun Chen authored Oct 26, 2025
```
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  6371f7af
- [misc] depdencies & enviroment flag (#12113) · 8491c794
  Liangsheng Yin authored Oct 26, 2025
  
  8491c794
- [log] Make forward iter count optional (#12116) · bda3758f
  Liangsheng Yin authored Oct 26, 2025
  
  bda3758f
- Clean up attention backend selection code & Other minor rename (#12136) · 7b36c47b
  Lianmin Zheng authored Oct 25, 2025
  
  7b36c47b
- [router] cleaned up all the redundant comments in the config module (#12147) · 773d89da
  Chang Su authored Oct 25, 2025
  
  773d89da
- [router] update smg code owners for each component (#12141) · 03e7d949
  Simo Lin authored Oct 25, 2025
  
  03e7d949
- [NVIDIA] Change default quant method for model_opt (#11991) · ff604064
  Kaixi Hou authored Oct 25, 2025
  
  ff604064
- [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) · 212f5e48
  Simo Lin authored Oct 25, 2025
  
  212f5e48
- docs: update README (#12139) · fe527812
  Yineng Zhang authored Oct 25, 2025
  
  fe527812
- [Doc] Small update of DeepSeek v3.2 document (#12138) · 97828878
  Baizhou Zhang authored Oct 25, 2025
  
  97828878
- Make bmm batch invariant injection optional (#12118) · c001deba
  fzyzcjy authored Oct 26, 2025
  
  c001deba
- [docs] upd docker files names everywhere (#12133) · b4d2da10
  Vincent Zhong authored Oct 25, 2025
  
  b4d2da10
- [Test] Add dsv3.2 nsa backend testing (#11936) · b72f9f08
  Johnsonms authored Oct 25, 2025
  
  b72f9f08
25 Oct, 2025 16 commits
- Clean up server launch code and multi tokenizer (#12132) · 8e70064c
  Lianmin Zheng authored Oct 25, 2025
  
  8e70064c
- Accelerate deepseek fp4 b200 ci (#11993) · d98b81e2
  Qiaolin Yu authored Oct 25, 2025
  
  d98b81e2
- [Doc] Fix format for deepseek v3.2 document (#12130) · bcecf27e
  Baizhou Zhang authored Oct 25, 2025
  
  bcecf27e
- Update sgl-kernel version to 0.3.16.post4 (#12125) · 4b0ac1d5
  Baizhou Zhang authored Oct 25, 2025
  
  4b0ac1d5
- Update document index for DeepSeek-v32 docs (#12101) · 8e987fa2
  Baizhou Zhang authored Oct 25, 2025
  
  8e987fa2
- Reenable b200 tests (#11814) · 9e656dd3
  Kangyan-Zhou authored Oct 25, 2025
  
  9e656dd3
- Fix token for CI monitor (#12127) · 3862661c
  Lianmin Zheng authored Oct 25, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  3862661c
- Fix Illegal Instruction/IMA errors when using DP attention --... · c8492978
  YAMY authored Oct 25, 2025
```
Fix Illegal Instruction/IMA errors when using DP attention -- num_tokens_for_logprob calculation (#12115)
```
  c8492978
- clean up github tokens (#12126) · 428710c2
  Lianmin Zheng authored Oct 25, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  428710c2
- Skip TestLlama4LoRA in CI (#12098) · d9b31011
  Lifu Huang authored Oct 25, 2025
  
  d9b31011
- [CI] Add ci monitor balance workflow (#11962) · d0cff78f
  Xiaoyu Zhang authored Oct 26, 2025
  
  d0cff78f
- [Misc] Improve the error message of failed import (#12119) · e8b71445
  DarkSharpness authored Oct 26, 2025
  
  e8b71445
- Clean up server args & Add CI scripts (#12124) · 4caca1ba
  Lianmin Zheng authored Oct 25, 2025
  
  4caca1ba
- Update setup_github_runner.md · ceb105a7
  Kangyan-Zhou authored Oct 25, 2025
  
  ceb105a7
- [bugs] docker file name should be <name>.Dockerfile so it can properly render (#11869) · 22cbc9c0
  Simo Lin authored Oct 25, 2025
  
  22cbc9c0
- fix: release workflow should work on both archs (#12110) · 3865afc5
  ishandhanani authored Oct 24, 2025
  
  3865afc5