Commits · fdc4e1e570503ddfc248aaa9ce6526c1eec92da2 · change / sglang

03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
26 Sep, 2025 1 commit
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
30 Aug, 2025 1 commit
- Adds initialize_moe_config to bench_one_batch so MOE backend is respected (#9670) · 42f34437
  pranavm-nvidia authored Aug 29, 2025
  
  42f34437
15 Aug, 2025 1 commit
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
13 Aug, 2025 1 commit

Lianmin Zheng authored Aug 13, 2025


Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9e426466

09 Aug, 2025 1 commit
- [bugfix] Fix missing args in bench one batch (#8877) · 52e1f52f
  Trevor Morris authored Aug 09, 2025
  
  52e1f52f
08 Aug, 2025 1 commit
- Enhancements for bench_one_batch (#8703) · ed0a3dd5
  Zaili Wang authored Aug 08, 2025
```
Co-authored-by: root <root@gnr630186.jf.intel.com>
```
  ed0a3dd5
31 Jul, 2025 1 commit
- [Feature] Hybrid EP and TP (#8590) · 7a1f7fc5
  Cheng Wan authored Jul 31, 2025
  
  7a1f7fc5
16 Jul, 2025 1 commit
- Use device_group for all_gather when disabling overlap scheduling (#8001) · 69f453e5
  Qiaolin Yu authored Jul 15, 2025
  
  69f453e5
20 Jun, 2025 1 commit
- [Feature] Comprehensive Hybrid Parallelism Support (#6389) · e879d8b7
  Cheng Wan authored Jun 20, 2025
  
  e879d8b7
17 May, 2025 1 commit
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a
16 May, 2025 1 commit
- feat: add dp attention support for Qwen 2/3 MoE models, fixes #6088 (#6121) · 4bd2952a
  Fr4nk1in authored May 17, 2025
```
Co-authored-by: King.Zevin <zevin@mail.ustc.edu.cn>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  4bd2952a
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
08 May, 2025 1 commit
- Tiny refactor ModelConfig.from_server_args (#5219) · b6cf3532
  fzyzcjy authored May 08, 2025
  
  b6cf3532
01 May, 2025 1 commit
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec
27 Apr, 2025 2 commits
- [CI] Fix ci tests (#5769) · 621e96bf
  Lianmin Zheng authored Apr 27, 2025
  
  621e96bf
- [misc] more decode step log for batch_one_batch (#5565) · f55933e1
  JieXin Liang authored Apr 27, 2025
  
  f55933e1
20 Apr, 2025 2 commits
- [Doc]Add instruction for profiling with bench_one_batch (#5581) · b54b5a96
  Baizhou Zhang authored Apr 20, 2025
  
  b54b5a96
- Fix bench_one_batch producing unnatural results for expert parallel (#5149) · d07e797a
  fzyzcjy authored Apr 20, 2025
  
  d07e797a
11 Apr, 2025 1 commit
- Support `--enable-llama4-multimodal` (#5254) · 038bc5d5
  Cheng Wan authored Apr 11, 2025
  
  038bc5d5
09 Apr, 2025 1 commit
- Let `bench_one_batch` support `enable_dp_attention` (#4058) · 61970b08
  fzyzcjy authored Apr 09, 2025
  
  61970b08
25 Mar, 2025 1 commit
- Super tiny fix typo (#4738) · f01b0925
  fzyzcjy authored Mar 25, 2025
  
  f01b0925
05 Mar, 2025 1 commit
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
26 Jan, 2025 1 commit
- Add CPU affinity setting to latency benchmark (#3085) · f8b28e46
  Hubert Lu authored Jan 25, 2025
  
  f8b28e46
22 Jan, 2025 1 commit
- Use int64 as indices for set_kv_buffer (#3039) · 3d8f1c9b
  Lianmin Zheng authored Jan 21, 2025
  
  3d8f1c9b
20 Jan, 2025 2 commits
- [Enhancement] Custom Logit Processor Improvement (#2998) · 583697cd
  Hongpeng Guo authored Jan 20, 2025
```
Signed-off-by: Hongpeng Guo <hpguo@anyscale.com>
```
  583697cd
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
16 Jan, 2025 1 commit
- add profiling to bench_one_batch script (#2821) · e00e5385
  Yun Dai authored Jan 16, 2025
  
  e00e5385
02 Jan, 2025 1 commit
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
23 Dec, 2024 1 commit
- Fix gemlite import (#2553) · 23e5e50f
  Lianmin Zheng authored Dec 22, 2024
  
  23e5e50f
20 Dec, 2024 1 commit
- Add integration with gemlite weight only quant (#2528) · feb2b768
  Jerry Zhang authored Dec 20, 2024
  
  feb2b768
02 Dec, 2024 1 commit
- Update model_loader deps and qqq quantization deps (#2220) (#2318) · 85e1a6f3
  Yineng Zhang authored Dec 02, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  85e1a6f3
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
27 Nov, 2024 1 commit
- Release v0.3.6.post2 (#2214) · fed4c694
  Lianmin Zheng authored Nov 27, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  fed4c694
24 Nov, 2024 1 commit
- Update CI threshold & Improve code style (#2159) · 5652c565
  Lianmin Zheng authored Nov 24, 2024
  
  5652c565
23 Nov, 2024 1 commit
- Add initial support for intel Gaudi accelerators (#2121) · 865233e2
  Ankur Neog authored Nov 23, 2024
  
  865233e2
22 Nov, 2024 1 commit
- Rename sglang.bench_latency to sglang.bench_one_batch (#2118) · dfec7fca
  Lianmin Zheng authored Nov 21, 2024
  
  dfec7fca
20 Nov, 2024 1 commit
- Enable overlap by default (#2067) · 7d671e4a
  Lianmin Zheng authored Nov 19, 2024
  
  7d671e4a
16 Nov, 2024 1 commit
- Add Tensor Parallel to torch_native_llama (#1876) · cf248976
  Ke Wen authored Nov 15, 2024
  
  cf248976
03 Nov, 2024 1 commit
- Unify the model type checking (#1905) · 0abbf289
  Lianmin Zheng authored Nov 03, 2024
  
  0abbf289