Commits · 14d80648030888335ea58e7e33dcdef5cbbee4a8 · change / sglang · GitLab

03 Nov, 2025 1 commit
- fix: Fix KTransformers hybrid inference with int8 quantization and format (#12536) · 14d80648
  Atream authored Nov 03, 2025
  
  14d80648
31 Oct, 2025 1 commit
- Support Kimi Linear (#12469) · a4bf5c6a
  Ke Bao authored Nov 01, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  a4bf5c6a
30 Oct, 2025 3 commits
- [Feature] Support DeepSeek MTP on NPU (#11897) · ce6b17c0
  Even Zhou authored Oct 30, 2025
```
Co-authored-by: liupeng374 <liupeng374@huawei.com>
```
  ce6b17c0
- [Feature] Initial eagle3 support for Deepseek-like models (#12319) · 78c43d88
  JensenFire authored Oct 30, 2025
  
  78c43d88
- Fuse wk and weight_proj in Indexer for DeepSeekV3.2-FP4 (#12094) · 9ff9fa7f
  Trevor Morris authored Oct 29, 2025
  
  9ff9fa7f
29 Oct, 2025 3 commits
- [2/2] Deepseek deterministic: support deepseek v3 deterministic inference on 8 x H200 (#12095) · e39628fd
  Minglei Zhu authored Oct 29, 2025
  
  e39628fd
- a tiny fix for support deepseek bf16 weights (#12313) · 0297773a
  Gao016 authored Oct 29, 2025
```
Co-authored-by: gaochang <gaochang@U-19PX2WQ1-0350.local>
```
  0297773a
- [hotfix] missing `w13_weight_fp8` and `w2_weight_fp8` in UE8M0 requantization (#12259) · 83087247
  Cheng Wan authored Oct 28, 2025
  
  83087247
28 Oct, 2025 1 commit
- Support running FP4 Deepseek on SM120. (#11708) · 88596739
  weiliang authored Oct 28, 2025
  
  88596739
25 Oct, 2025 1 commit
- [10/N] MoE Refactor: reorganize deepgemm runner in DeepEPMoE (#12054) · 64994980
  Cheng Wan authored Oct 24, 2025
  
  64994980
24 Oct, 2025 2 commits
- [1/2] deepseek deterministic: support deterministic inference for deepseek... · f4b78d13
  Minglei Zhu authored Oct 24, 2025
```
[1/2] deepseek deterministic: support deterministic inference for deepseek arch models on a single GPU (#12000)
```
  f4b78d13
- Opt MHA chunked prefix: merge prefix and extend kv cache to run mha once (#10953) · 4793ec7d
  Yongfei Xu authored Oct 24, 2025
  
  4793ec7d
23 Oct, 2025 2 commits

model: support deepseek-ocr (#11891) · 770529a7

Mick authored Oct 24, 2025

Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

770529a7

Add AWQ quantization support for NPU. (#10158) · 39c237f0

ErvinXie authored Oct 24, 2025


Co-authored-by: Alisehen <814073252@qq.com>
Co-authored-by: Yaochen Han <48639761+Alisehen@users.noreply.github.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>

39c237f0

22 Oct, 2025 1 commit
- [lint] improve ruff check (#11922) · 9d61205d
  Liangsheng Yin authored Oct 22, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  9d61205d
21 Oct, 2025 1 commit
- init support for KTransformers Heterogeneous Computing (#11487) · 7e6191c0
  Atream authored Oct 21, 2025
```
Co-authored-by: Jianwei Dong <1913953267@qq.com>
```
  7e6191c0
20 Oct, 2025 2 commits
- [9/N] MoE Refactor: cleanup dispatcher interfaces (#11847) · bfc3b3f7
  Cheng Wan authored Oct 20, 2025
  
  bfc3b3f7
- [BugFix] replace the input_to_float8 used in dsv2 (#11612) · be0058bc
  Liu-congo authored Oct 20, 2025
```
Signed-off-by: Liu-congo <1502632128@qq.com>
```
  be0058bc
19 Oct, 2025 2 commits
- Change bf16 to fp8 for some gemms in attention for DeepSeek ckpt v2 (#11805) · 12eb02e9
  fzyzcjy authored Oct 19, 2025
  
  12eb02e9
- Make single-batch overlap compatible with NextN (#11804) · ce399e15
  fzyzcjy authored Oct 19, 2025
  
  ce399e15
18 Oct, 2025 4 commits
- [Refactor] move `deep_gemm_wrapper` out of `quantization` (#11784) · 5b214b50
  Cheng Wan authored Oct 17, 2025
  
  5b214b50
- Make single-batch overlap compatible with offloading (#11614) · 33e9bbec
  fzyzcjy authored Oct 18, 2025
  
  33e9bbec
- Super tiny fix CI (#11788) · dcb8f090
  fzyzcjy authored Oct 18, 2025
  
  dcb8f090
- Support casting bf16 NextN moe to fp8 (#11613) · 8af84912
  fzyzcjy authored Oct 18, 2025
  
  8af84912
17 Oct, 2025 2 commits
- Support shared experts overlap in cutlass moe (#11611) · 505329ca
  fzyzcjy authored Oct 18, 2025
  
  505329ca
- [Lint] Add `python/sglang` to ruff F401 checks and remove unused imports in files (#11685) · 62797440
  Chang Su authored Oct 17, 2025
  
  62797440
16 Oct, 2025 1 commit
- [Bugfix] Fix Qwen3/DSV3/DSV3.2 model support (#11510) · 3cceaa38
  Even Zhou authored Oct 16, 2025
  
  3cceaa38
15 Oct, 2025 1 commit
- [1/N] Introduce Mooncake Backend and Mooncake EP to Support Elastic EP (#10423) · a40229f6
  Xun Sun authored Oct 15, 2025
```
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  a40229f6
13 Oct, 2025 2 commits
- Depreate `global_server_args_dict` (#11528) · 516738b0
  Liangsheng Yin authored Oct 13, 2025
  
  516738b0
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 1 commit
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
11 Oct, 2025 1 commit
- [BugFix] test_mla_fp8.py fails on Cublas 12.9 (#11360) · c80a96da
  Liu-congo authored Oct 11, 2025
```
Signed-off-by: Liu-congo <1502632128@qq.com>
```
  c80a96da
06 Oct, 2025 1 commit

Support DeepSeek V3.2 Exp (#11061) · efbc687c

fzyzcjy authored Oct 06, 2025


Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

efbc687c

02 Oct, 2025 5 commits
- Tiny cleanup deepseek_v2.py (#11163) · b65db028
  fzyzcjy authored Oct 02, 2025
  
  b65db028
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
- Support dispatch low latency (#10263) · 0b9dfba7
  fzyzcjy authored Oct 02, 2025
```
Co-authored-by: Kaixi Hou <4001424+kaixih@users.noreply.github.com>
```
  0b9dfba7
- Fuse quantize and rope in trtllm_mla MTP (#10779) · f35def86
  fzyzcjy authored Oct 02, 2025
  
  f35def86
- Fix DeepSeek chunked prefill memory issue (#11149) · 44b1fbe2
  fzyzcjy authored Oct 02, 2025
  
  44b1fbe2
23 Sep, 2025 1 commit
- [Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130) · d27a6f70
  Even Zhou authored Sep 23, 2025
  
  d27a6f70
22 Sep, 2025 1 commit

[Auto Sync] Update deepseek_v2.py (20250922) (#10717) · f67d1f45

Yineng Zhang authored Sep 21, 2025


Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Michael Granado <mgranado@together.ai>

f67d1f45