Commits · 3ae33fcd0a6a68feac788fcf2db3a088c526e657 · change / sglang

"vscode:/vscode.git/clone" did not exist on "e2fbe4d23850150bd2b8b3e59ed08f97ff5c4452"

07 Aug, 2025 10 commits
- Fix hopper launch gpt-oss model illegal memory (#8908) · 3ae33fcd
  Xiaoyu Zhang authored Aug 08, 2025
  
  3ae33fcd
- [Perf] Auto enable best flashinfer mxfp4 kernel in b200 (#8898) · 47824c14
  Xiaoyu Zhang authored Aug 07, 2025
  
  47824c14
- Disable gemma3 for SWA due to CUDA illegal memory access error (#8895) · c36a6693
  Xinyuan Tong authored Aug 07, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  c36a6693
- [CPU] Fix fallback allgather issue (#8041) · 62f8eb48
  blzheng authored Aug 07, 2025
  
  62f8eb48
- [Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949) · b7cd7430
  PGFLMG authored Aug 07, 2025
  
  b7cd7430
- [Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292) · 2d120f8b
  Zheng Wengang authored Aug 07, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  2d120f8b
- Enables force reasoning based on chat template for Qwen3-Thinking (#8369) · 3fa3c6cd
  Xinyuan Tong authored Aug 06, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Chang Su <csu272@usc.edu>
```
  3fa3c6cd
- Support GPU pinning for LoRA (#8697) · 6210e2c4
  Lifu Huang authored Aug 06, 2025
  
  6210e2c4
- feat: openai oss attention sink support with trtllm-gen backend #8825 (#8834) · 6ad6c8c9
  eigen authored Aug 06, 2025
```
Co-authored-by: averyhuang <averyh@nvidia.com>
```
  6ad6c8c9
- fix glm4 moe (#8883) · 5b6acc14
  Cheng Wan authored Aug 06, 2025
  
  5b6acc14
06 Aug, 2025 13 commits
- add flashinfer mxfp4 (#8847) · 4373df55
  Xiaoyu Zhang authored Aug 07, 2025
  
  4373df55
- Use reduce scatter for DP (#8539) · c0e84297
  Trevor Morris authored Aug 06, 2025
  
  c0e84297
- Support v1/responses and use harmony in serving_chat (#8837) · 92cc32d9
  Chang Su authored Aug 06, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  92cc32d9
- [NVIDIA] Fix num_experts in modelopt_quant (#8811) · 288ae41f
  Shu Wang authored Aug 06, 2025
  
  288ae41f
- Optimize triton swa kernel by skipping computation (#8860) · 0475448e
  Ke Bao authored Aug 06, 2025
  
  0475448e
- Refine naming (#8868) · 399e7ec8
  Ke Bao authored Aug 06, 2025
  
  399e7ec8
- Support mxfp4 for GPT-OSS (#8843) · 168033d5
  Ying Sheng authored Aug 06, 2025
```
Co-authored-by: Co-author fzyzcjy <ch271828n@outlook.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: liz-badada <jinyanc@nvidia.com>
Co-authored-by: xutizhou <xutingz@nvidia.com>
Co-authored-by: linhu-nv <linhu@nvidia.com>
```
  168033d5
- [2/3] Optimize Slime Update Weights: Avoid GPU-to-CPU Device Sync when update... · cbbb7383
  Stefan He authored Aug 05, 2025
```
[2/3]  Optimize Slime Update Weights: Avoid GPU-to-CPU Device Sync when update expert weights (#8753)
```
  cbbb7383
- [1/3] Optimize Slime Update Weights: Remove QWen3MOE Load Weight Overhead (#8751) · 89588179
  Stefan He authored Aug 05, 2025
  
  89588179
- [Feature] improve TBO: two chunk overlap (#8144) · ca47e24f
  HouseWest authored Aug 06, 2025
  
  ca47e24f
- Support bailing moe (#8680) · d26ca84f
  Praneth Paruchuri authored Aug 06, 2025
  
  d26ca84f
- Turn off hybrid cache by default (#8839) · 8128e08d
  Ke Bao authored Aug 06, 2025
  
  8128e08d
- chore: upgrade torch 2.8.0 (#8836) · 3ae8e3ea
  Yineng Zhang authored Aug 05, 2025
  
  3ae8e3ea
05 Aug, 2025 14 commits
- Add initial support for gpt-oss (#8824) · c1d2061f
  Ying Sheng authored Aug 05, 2025
  
  c1d2061f
- fix: remove unused import (#8809) · 556e4143
  Yineng Zhang authored Aug 05, 2025
  
  556e4143
- Fix potential memory fault issue and ncclSystemError in CI test (#8681) · 32d9e39a
  kk authored Aug 06, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  32d9e39a
- chore: upgrade flashinfer 0.2.10 (#8827) · 4f4e0e41
  Yineng Zhang authored Aug 05, 2025
  
  4f4e0e41
- chore: upgrade transformers 4.55.0 (#8823) · 901ab758
  Yineng Zhang authored Aug 05, 2025
```
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  901ab758
- GLM-4.5 and GLM-4.5-Air both support (#8804) · a4b0d5c9
  Yuxuan Zhang authored Aug 05, 2025
  
  a4b0d5c9
- feat: add trtllm-gen mha from direct call (#8782) · 40e3b2be
  eigen authored Aug 05, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  40e3b2be
- Revert "[NVIDIA]Fix local_num_experts for EP (#8779)" (#8797) · 5e91fed1
  Yineng Zhang authored Aug 04, 2025
  
  5e91fed1
- [feat] Add detail in image_data (#8596) · 873f384a
  Yuhao Yao authored Aug 05, 2025
  
  873f384a
- [NVIDIA]Fix local_num_experts for EP (#8779) · b01eeb80
  Shu Wang authored Aug 05, 2025
  
  b01eeb80
- chore: upgrade flashinfer v0.2.9 (#8780) · 1ea94d3b
  Yineng Zhang authored Aug 04, 2025
  
  1ea94d3b
- [PD] Refactor parallel sizes and add pp support for mooncake (#8571) · d98a4913
  Shangming Cai authored Aug 05, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  d98a4913
- Support OCP MXFP4 quantization on AMD GPUs (#8255) · d4bf5a85
  kk authored Aug 05, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
```
  d4bf5a85
- [Fix] Fix several issues preventing gemma3n LoRA support. (#8776) · 7cb20754
  Lifu Huang authored Aug 04, 2025
  
  7cb20754
04 Aug, 2025 3 commits
- [NVIDIA] Fix breakage of using trtllm-gen fp8 moe (#8773) · 6d0646da
  Kaixi Hou authored Aug 04, 2025
  
  6d0646da
- [bugfix] Fix typo in modelopt quant: 'FusedMoE' object has no attribute 'local_num_experts' (#8768) · 9bd4872a
  Trevor Morris authored Aug 04, 2025
  
  9bd4872a
- [NVIDIA] Add Low Latency NVFP4 decode kernels from Flashinfer (#8552) · 915140fd
  azhurkevich authored Aug 04, 2025
```
Co-authored-by: Cheng Wan <cwan@x.ai>
```
  915140fd