Commits · e07a6977e7b444e057689344fcf23d612ff9b897 · zhaoyu6 / sglang

"official/nlp/bert/run_classifier.py" did not exist on "ce03903f516731171633d92a50e2218a4d3303b6"

15 May, 2025 9 commits
- Minor improvements of TokenizerManager / health check (#6327) · e07a6977
  Lianmin Zheng authored May 15, 2025
  
  e07a6977
- Fix lora bench (#6302) · cd8d4b9d
  Qiaolin Yu authored May 15, 2025
  
  cd8d4b9d
- Reduce MoE memory usage (#6147) · f194e14f
  fzyzcjy authored May 16, 2025
  
  f194e14f
- Fix gpu mem check on CPU (#6317) · cfc9f9ab
  Yi Liu authored May 16, 2025
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  cfc9f9ab
- Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216) · fb4959b2
  Chunyuan WU authored May 16, 2025
```
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fb4959b2
- [misc] remove redundant platform codes (#6298) · 9a405274
  JieXin Liang authored May 15, 2025
  
  9a405274
- [Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) · 2e4babdb
  quinnrong94 authored May 15, 2025
```
Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>
```
  2e4babdb
- [fix][RL] Remove the incorrect barrier in init_weights_update_group (#5914) · 44a3783d
  Zilin Zhu authored May 15, 2025
  
  44a3783d
- feat: add flush cache to EngineBase and HttpServerEngineAdapter (#6009) · f3bf6110
  Junrong Lin authored May 15, 2025
  
  f3bf6110
14 May, 2025 7 commits
- [AMD] Fix Llama 4 Scout and Maverick accuracy issues on MI300X (#6274) · 198b9056
  Hubert Lu authored May 14, 2025
  
  198b9056
- Enable unit tests for AMD CI. (#6283) · 73eb67c0
  Sai Enduri authored May 14, 2025
  
  73eb67c0
- docs: fix a bad redirect (#6300) · 9a91fa0e
  Brayden Zhong authored May 14, 2025
  
  9a91fa0e
- doc: update developer guide regarding mllms (#6138) · cd7c8a8d
  Mick authored May 14, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
```
  cd7c8a8d
- [Bug] Fix accidental logger override caused by internVL. (#6282) · 3e350a93
  Lifu Huang authored May 13, 2025
  
  3e350a93
- Fix a bug in schedule_policy (#6276) · fb71725c
  Ying Sheng authored May 13, 2025
  
  fb71725c
- perf: optimize local_block_table memory allocation (#6273) · 912788c0
  Chang Su authored May 13, 2025
  
  912788c0
13 May, 2025 9 commits
- [CPU] Add CMakeLists.txt for sgl-kernel (#6115) · 0f75b907
  blzheng authored May 14, 2025
  
  0f75b907
- chore: bump v0.4.6.post4 (#6245) · 16267d4f
  Yineng Zhang authored May 13, 2025
  
  16267d4f
- Enable MI325X AMD CI. (#6259) · 0f5cb8ca
  Sai Enduri authored May 13, 2025
  
  0f5cb8ca
- [misc] deep_gemm fallback to NVRTC when NVCC not found (#6252) · 17299f08
  JieXin Liang authored May 13, 2025
  
  17299f08
- model(vlm): pixtral (#5084) · 5380cd7e
  Kiv Chen authored May 13, 2025
  
  5380cd7e
- Fix two issues related to `--moe-dense-tp-size=1` (#5657) · b2e95f62
  Cheng Wan authored May 13, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: 颉沆 <xiehang.lsy@alibaba-inc.com>
```
  b2e95f62
- [VERL Use Case] Add torch_memory_saver into deps (#6247) · 1ab14c4c
  Stefan He authored May 12, 2025
  
  1ab14c4c
- [Llama4] Add docs note about enable multimodal (#6235) · 3c32895c
  Brayden Zhong authored May 12, 2025
  
  3c32895c
- Skip the flaky test_stateful_custom_logit_processor (#6251) · ac2324c1
  Lianmin Zheng authored May 12, 2025
  
  ac2324c1
12 May, 2025 15 commits
- Support tuning moe for llama 4 model (#6042) · ef8ec07b
  fzyzcjy authored May 13, 2025
  
  ef8ec07b
- fix typo (#6248) · f24fc5b8
  Yineng Zhang authored May 12, 2025
  
  f24fc5b8
- Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225) · d18c6b33
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d18c6b33
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- Update AMD nightly deps. (#6241) · 983c663d
  Sai Enduri authored May 12, 2025
  
  983c663d
- chore: add hf_xet dep (#6243) · f94543d2
  Yineng Zhang authored May 12, 2025
  
  f94543d2
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- [PP] Fix init_memory_pool desync & add PP for mixtral (#6223) · bad7c26f
  Ying Sheng authored May 12, 2025
  
  bad7c26f
- [Docs] Add docs for `SGLANG_` and `SGL_` environment variables (#6206) · 12319a67
  Brayden Zhong authored May 12, 2025
  
  12319a67
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
- [CI] Re-enable pd disaggregation test (#6231) · 3ee40ff9
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ee40ff9
- [CI] Fix PD mooncake dependency error (#6212) · 0f334945
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  0f334945
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
- Update AMD CI docker to v0.4.6.post3-rocm630. (#6213) · 7d3a3d45
  Sai Enduri authored May 12, 2025
  
  7d3a3d45
- Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558) · 25c83fff
  Cheng Wan authored May 12, 2025
```
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
```
  25c83fff