Commits · 6c1a3f0cb203b695a700ad3cdbd5e5a541a0ed28 · change / sglang · GitLab

30 Oct, 2025 1 commit
- enable cudaProfilerApi for one batch benchmarking (#11116) · 6c1a3f0c
  lpc0220 authored Oct 30, 2025
  
  6c1a3f0c
21 Oct, 2025 1 commit

Init attention backend for Intel XPU (#10656) · b113c72e

Meng, Hengyu authored Oct 21, 2025


Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>

b113c72e

18 Oct, 2025 3 commits
- [RL] use cpu group to prepare_mlp_sync_batch_raw when the server is offloaded (#10152) · e68a2b5b
  Zilin Zhu authored Oct 18, 2025
  
  e68a2b5b
- [Refactor] move `deep_gemm_wrapper` out of `quantization` (#11784) · 5b214b50
  Cheng Wan authored Oct 17, 2025
  
  5b214b50
- Set CUDA_VISIBLE_DEVICES to achieve one GPU per process (#9170) · 9eefe2c0
  Lianmin Zheng authored Oct 17, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Cheng Wan <cwan@x.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  9eefe2c0
16 Oct, 2025 1 commit
- enable rmsnorm on XPU (#10248) · 729b7edf
  Huaiyu, Zheng authored Oct 16, 2025
  
  729b7edf
11 Oct, 2025 1 commit
- Separate allocation logic from scheduler (#11313) · b36afed4
  cctry authored Oct 10, 2025
  
  b36afed4
10 Oct, 2025 1 commit
- fix: fix gpu-proc affinity set incorrectly when pp_size > 1 (#11389) · 0fe87213
  Yingchun Lai authored Oct 10, 2025
  
  0fe87213
08 Oct, 2025 1 commit
- Clean match_prefix and prepare_for_extend for mem cache V2 (#11200) · f3764c26
  cctry authored Oct 07, 2025
  
  f3764c26
03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
26 Sep, 2025 1 commit
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
30 Aug, 2025 1 commit
- Adds initialize_moe_config to bench_one_batch so MOE backend is respected (#9670) · 42f34437
  pranavm-nvidia authored Aug 29, 2025
  
  42f34437
15 Aug, 2025 1 commit
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
13 Aug, 2025 1 commit

Clean up allocators (#9134) · 9e426466

Lianmin Zheng authored Aug 13, 2025


Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9e426466

09 Aug, 2025 1 commit
- [bugfix] Fix missing args in bench one batch (#8877) · 52e1f52f
  Trevor Morris authored Aug 09, 2025
  
  52e1f52f
08 Aug, 2025 1 commit
- Enhancements for bench_one_batch (#8703) · ed0a3dd5
  Zaili Wang authored Aug 08, 2025
```
Co-authored-by: root <root@gnr630186.jf.intel.com>
```
  ed0a3dd5
31 Jul, 2025 1 commit
- [Feature] Hybrid EP and TP (#8590) · 7a1f7fc5
  Cheng Wan authored Jul 31, 2025
  
  7a1f7fc5
16 Jul, 2025 1 commit
- Use device_group for all_gather when disabling overlap scheduling (#8001) · 69f453e5
  Qiaolin Yu authored Jul 15, 2025
  
  69f453e5
20 Jun, 2025 1 commit
- [Feature] Comprehensive Hybrid Parallelism Support (#6389) · e879d8b7
  Cheng Wan authored Jun 20, 2025
  
  e879d8b7
17 May, 2025 1 commit
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a
16 May, 2025 1 commit
- feat: add dp attention support for Qwen 2/3 MoE models, fixes #6088 (#6121) · 4bd2952a
  Fr4nk1in authored May 17, 2025
```
Co-authored-by: King.Zevin <zevin@mail.ustc.edu.cn>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  4bd2952a
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
08 May, 2025 1 commit
- Tiny refactor ModelConfig.from_server_args (#5219) · b6cf3532
  fzyzcjy authored May 08, 2025
  
  b6cf3532
01 May, 2025 1 commit
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec
27 Apr, 2025 2 commits
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
- [misc] more decode step log for batch_one_batch (#5565) · f55933e1
  JieXin Liang authored Apr 27, 2025
  
  f55933e1
20 Apr, 2025 2 commits
- [Doc]Add instruction for profiling with bench_one_batch (#5581) · b54b5a96
  Baizhou Zhang authored Apr 20, 2025
  
  b54b5a96
- Fix bench_one_batch producing unnatural results for expert parallel (#5149) · d07e797a
  fzyzcjy authored Apr 20, 2025
  
  d07e797a
11 Apr, 2025 1 commit
- Support `--enable-llama4-multimodal` (#5254) · 038bc5d5
  Cheng Wan authored Apr 11, 2025
  
  038bc5d5
09 Apr, 2025 1 commit
- Let `bench_one_batch` support `enable_dp_attention` (#4058) · 61970b08
  fzyzcjy authored Apr 09, 2025
  
  61970b08
25 Mar, 2025 1 commit
- Super tiny fix typo (#4738) · f01b0925
  fzyzcjy authored Mar 25, 2025
  
  f01b0925
05 Mar, 2025 1 commit
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
26 Jan, 2025 1 commit
- Add CPU affinity setting to latency benchmark (#3085) · f8b28e46
  Hubert Lu authored Jan 25, 2025
  
  f8b28e46
22 Jan, 2025 1 commit
- Use int64 as indices for set_kv_buffer (#3039) · 3d8f1c9b
  Lianmin Zheng authored Jan 21, 2025
  
  3d8f1c9b
20 Jan, 2025 2 commits
- [Enhancement] Custom Logit Processor Improvement (#2998) · 583697cd
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  583697cd
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
16 Jan, 2025 1 commit
- add profiling to bench_one_batch script (#2821) · e00e5385
  Yun Dai authored Jan 16, 2025
  
  e00e5385
02 Jan, 2025 1 commit
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
23 Dec, 2024 1 commit
- Fix gemlite import (#2553) · 23e5e50f
  Lianmin Zheng authored Dec 22, 2024
  
  23e5e50f
20 Dec, 2024 1 commit
- Add integration with gemlite weight only quant (#2528) · feb2b768
  Jerry Zhang authored Dec 20, 2024
  
  feb2b768