Commits · ce5ee3bdf0838c73856d0354a3259f231f9ae9b8 · zhaoyu6 / sglang

"src/vscode:/vscode.git/clone" did not exist on "246c42367aabf4a35df1cbed4e555b6d5b397f68"

10 Jun, 2025 2 commits
- Clean up server_args.py (#7037) · 6406408a
  Lianmin Zheng authored Jun 10, 2025
  
  6406408a
- Support both approximate and exact expert distribution collection (#6964) · f6ebba53
  fzyzcjy authored Jun 10, 2025
  
  f6ebba53
09 Jun, 2025 1 commit
- Simplify prepare_extend_after_decode (#6987) · dc0705a5
  Lianmin Zheng authored Jun 09, 2025
  
  dc0705a5
07 Jun, 2025 2 commits
- Disabling mixed chunked prefill when eagle is enabled (#6874) · e1ce44cd
  Swipe4057 authored Jun 07, 2025
  
  e1ce44cd
- Sync the changes on cuda graph runners (#6932) · 60fdad7c
  Lianmin Zheng authored Jun 06, 2025
  
  60fdad7c
05 Jun, 2025 2 commits
- Support layerwise rebalancing experts (#6851) · 0de5e7d4
  fzyzcjy authored Jun 05, 2025
  
  0de5e7d4
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 3 commits
- Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts... · 81964328
  Cheng Wan authored Jun 04, 2025
```
Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)
```
  81964328
- [FEAT] Add transformers backend support (#5929) · 37f15475
  Marc Sun authored Jun 04, 2025
  
  37f15475
- [Refactor] Rename `n_share_experts_fusion` as `num_fused_shared_experts` (#6735) · 8a548052
  Cheng Wan authored Jun 03, 2025
  
  8a548052
31 May, 2025 2 commits
- Improve profiler and integrate profiler in bench_one_batch_server (#6787) · 2d72fc47
  Lianmin Zheng authored May 31, 2025
  
  2d72fc47
- Add intel_amx backend for Radix Attention for CPU (#6408) · 888cb175
  YanbingJiang authored May 31, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  888cb175
29 May, 2025 5 commits
- Fix mem_fraction_static for AMD CI (#6748) · 73def253
  Baizhou Zhang authored May 29, 2025
  
  73def253
- Support picking variants of EPLB algorithms (#6728) · 3ab7d9b5
  fzyzcjy authored May 29, 2025
  
  3ab7d9b5
- Super tiny enable sole usage of expert distribution metrics and update doc (#6680) · 7e5071c9
  fzyzcjy authored May 29, 2025
  
  7e5071c9
- Tune memory arguments on B200 (#6718) · f2bd3515
  Baizhou Zhang authored May 29, 2025
  
  f2bd3515
- [fix] more mem for draft_extend cuda_graph (#6726) · 535c8386
  JieXin Liang authored May 29, 2025
  
  535c8386
27 May, 2025 2 commits
- Support EAGLE draft extend CUDA graph (#6606) · 63195028
  Ke Bao authored May 27, 2025
```
Co-authored-by: Sehoon Kim <sehoonkim@berkeley.edu>
```
  63195028
- Refactor LoRA handling to support adapter tensors in fused format (#6585) · 477a101c
  Lifu Huang authored May 26, 2025
  
  477a101c
26 May, 2025 2 commits
- Automatically configure for EPLB-related args (#6628) · fe386aca
  fzyzcjy authored May 26, 2025
  
  fe386aca
- Support fake perfectly balanced EP dispatch algorithm (#6571) · 0ca18117
  fzyzcjy authored May 26, 2025
  
  0ca18117
25 May, 2025 1 commit
- Support overlapping two batches (#4068) · 0d477880
  fzyzcjy authored May 25, 2025
  
  0d477880
24 May, 2025 1 commit
- [FIX]remove ServerArgs duplicate code (#6485) · 2e37fa07
  Neo authored May 24, 2025
  
  2e37fa07
23 May, 2025 2 commits
- Update cmdline --enable-dp-attention help string for Qwen 2/3 Moe models. (#6524) · fefa19fe
  miter authored May 24, 2025
```
Signed-off-by: miter <miterv@outlook.com>
```
  fefa19fe
- [2/2] Support Qserve (#6521) · 1b2e8f76
  HandH1998 authored May 24, 2025
  
  1b2e8f76
22 May, 2025 2 commits
- Support dynamically rebalancing experts using EPLB (#6469) · 7a80f565
  fzyzcjy authored May 22, 2025
  
  7a80f565
- Support logging expert balancedness metrics (#6482) · 9484eba4
  fzyzcjy authored May 22, 2025
  
  9484eba4
21 May, 2025 2 commits
- Support redundant experts in expert parallel (#6461) · ccfe5c00
  fzyzcjy authored May 21, 2025
  
  ccfe5c00
- aiter attention-backend (default enabled on AMD/ROCm) (#6381) · 5c0b38f3
  HAI authored May 20, 2025
  
  5c0b38f3
20 May, 2025 2 commits
- Support dispatching logical to physical experts (#6385) · e98afbe0
  fzyzcjy authored May 20, 2025
  
  e98afbe0
- Expert distribution recording without overhead for EPLB (#4957) · f0653886
  fzyzcjy authored May 20, 2025
  
  f0653886
19 May, 2025 1 commit
- [Metrics] Add KV events publishing (#6098) · 7adf245b
  Trevor Morris authored May 19, 2025
  
  7adf245b
18 May, 2025 1 commit
- Support custom DeepEP tuning config (#6257) · fd08c048
  fzyzcjy authored May 18, 2025
  
  fd08c048
15 May, 2025 2 commits
- Minor improvements of TokenizerManager / health check (#6327) · e07a6977
  Lianmin Zheng authored May 15, 2025
  
  e07a6977
- Fix gpu mem check on CPU (#6317) · cfc9f9ab
  Yi Liu authored May 16, 2025
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  cfc9f9ab
12 May, 2025 5 commits
- Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225) · d18c6b33
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d18c6b33
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd