Commits · d6fee73d1f593bd6754cd2550775fd2e54aeae60 · zhaoyu6 / sglang

"INSTALL/vscode:/vscode.git/clone" did not exist on "537f0eaa7e16df83a9e826cda9aa7967bc77717d"

23 Oct, 2025 3 commits
- Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4 (#11866) · d6fee73d
  Netanel Haber authored Oct 23, 2025
  
  d6fee73d
- [CPU] Optimize FP16 decode_attention_cpu (#10652) · 13fb8b54
  blzheng authored Oct 23, 2025
  
  13fb8b54
- [ROCm] Remove vLLM rope dependency & use AITER impl (#11322) · 4d4feccb
  b8zhong authored Oct 22, 2025
  
  4d4feccb
22 Oct, 2025 3 commits
- Fix flaky hicache test with mooncake backend (#11953) · 7fceeef5
  Shangming Cai authored Oct 22, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  7fceeef5
- [2/N] Added the core structure of elastic EP and the eplb algorithm with faulty rank (#10606) · 904655c5
  Hank Han authored Oct 22, 2025
```
Co-authored-by: Xun Sun <UNIDY2002@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  904655c5
- Enable native ModelOpt quantization support (3/3) (#10154) · 80b2b320
  Zhiyu authored Oct 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  80b2b320
21 Oct, 2025 6 commits
- vlm: enforce pybase64 for image and str encode/decode (#10700) · d0a64c7e
  b8zhong authored Oct 21, 2025
  
  d0a64c7e
- [CI] disable glm4.1v and fix the flashinfer installation (#11902) · 05d3667a
  Shangming Cai authored Oct 21, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  05d3667a
- Support Thinking Budget (via custom_logit_processor for OpenAI API) [Fix #6572] (#11416) · dbb16bed
  ybyang authored Oct 21, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: YorkSu <york_su@qq.com>
```
  dbb16bed
- [FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570) · 852c0578
  Neelabh Sinha authored Oct 21, 2025
  
  852c0578
- Init attention backend for Intel XPU (#10656) · b113c72e
  Meng, Hengyu authored Oct 21, 2025
```
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  b113c72e
- piecewise cuda graph support qwen3-moe (#11845) · 8374a96e
  Xiaoyu Zhang authored Oct 21, 2025
  
  8374a96e
20 Oct, 2025 5 commits
- [Feature] New structural tag support (#10691) · 276e7b3e
  DarkSharpness authored Oct 20, 2025
  
  276e7b3e
- [Model] Add Olmo 3 model support (#11396) · d383e661
  Shane A authored Oct 19, 2025
  
  d383e661
- Support mrope triton kernel and add unit test (#11722) · 271d3d0d
  Yuan Luo authored Oct 20, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  271d3d0d
- [NVIDIA] FA3/FA4 Fix (#11606) · 252dc4e1
  Johnny authored Oct 20, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  252dc4e1
- [CI] Add CI test for DeepSeek V3.2 MTP (#11835) · cbb5fc2e
  Baizhou Zhang authored Oct 19, 2025
  
  cbb5fc2e
19 Oct, 2025 3 commits
- [logprobs] Enable local deterministic logrprobs testing with strict threshold (#10994) · 53fb229f
  Night authored Oct 19, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  53fb229f
- Deterministic Mode: Add 1-stage triton kernel for prefill (#11147) · 4fff1ec1
  Stefan He authored Oct 19, 2025
```
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>
```
  4fff1ec1
- [Test] Add basic matched stop for beta eagle (#11833) · 7a020e0f
  Liangsheng Yin authored Oct 20, 2025
  
  7a020e0f
18 Oct, 2025 2 commits
- ci: update `lmms-eval` to speed up multimodal CI (#11000) · f4f8a1b4
  b8zhong authored Oct 18, 2025
  
  f4f8a1b4
- completely remove mixed mode deterministic test as prefix mode could cover it (#11783) · 13219e1e
  Minglei Zhu authored Oct 17, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  13219e1e
17 Oct, 2025 4 commits
- [minor] sync code on python/sglang/test/test_deterministic.py and improve ci tests (#11777) · b9a54e09
  Lianmin Zheng authored Oct 17, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  b9a54e09
- Turn on shm_allreduce and shm_allgather for fp16 (#10725) · 8fcc69e7
  Chunyuan WU authored Oct 18, 2025
  
  8fcc69e7
- Revert "Set csgmv as default lora backend. (#11488)" (#11735) · da681f35
  Yineng Zhang authored Oct 17, 2025
  
  da681f35
- ci: reduce and refactor vlm ut and combine test files (#11062) · 3e4c7da2
  Mick authored Oct 17, 2025
  
  3e4c7da2
16 Oct, 2025 9 commits
- model: qwen3-omni (thinker-only) (#10911) · 86b04d25
  Mick authored Oct 17, 2025
```
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  86b04d25
- [ci]use H20 to run disaggregation test (#11543) · 0dd6cf16
  Hank Han authored Oct 17, 2025
  
  0dd6cf16
- [CI] Add GLM4MoE model test (#11706) · 1de3924b
  Shangming Cai authored Oct 16, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  1de3924b
- [Bugfix] Fix Qwen3/DSV3/DSV3.2 model support (#11510) · 3cceaa38
  Even Zhou authored Oct 16, 2025
  
  3cceaa38
- Set csgmv as default lora backend. (#11488) · b0d20cde
  Lifu Huang authored Oct 15, 2025
  
  b0d20cde
- Split test_intel_amx_attention_backend.py to pass CI of timeout (#11370) · cbac4997
  YanbingJiang authored Oct 16, 2025
```
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
```
  cbac4997
- [PD] Add PD support for hybrid model (Qwen3-Next, DeepSeek V3.2 Exp) (#10912) · 868403f6
  Shangming Cai authored Oct 16, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: ZeldaHuang <hzm414167@alibaba-inc.com>
```
  868403f6
- Sync code and test CI; rename some env vars (#11686) · cd7e1bd5
  Lianmin Zheng authored Oct 15, 2025
  
  cd7e1bd5
- [CI][XPU]enable sglang CI on Intel XPU (#9493) · 4c03dbaa
  DiweiSun authored Oct 16, 2025
```
Co-authored-by: huaiyuzh <huaiyu.zheng@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
```
  4c03dbaa
15 Oct, 2025 2 commits
- [1/N]Support DeepSeek-R1 w4a8 normal deepep (#8247) · 825432fc
  Jinwu authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
```
  825432fc
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
14 Oct, 2025 3 commits
- move eagle draft post process to cuda graph (#11434) · 56222658
  yinghui authored Oct 14, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  56222658
- Implement LRU eviction policy for LoRA adapters (#11041) · 28f80b12
  Chenxi Li authored Oct 13, 2025
  
  28f80b12
- [FEATURE] Add Profile Trace Merger for Distributed Traces (#11413) · aaf7af1b
  Neelabh Sinha authored Oct 13, 2025
  
  aaf7af1b