Commits · 14269198e3b59cf662da209cafdd7790c9dd634b · change / sglang

"configs/models/accessory/accessory_llama2_7b.py" did not exist on "ba027eeeac640e577b75103de95e312cada57026"

25 Mar, 2025 8 commits
- [Benchmark] tilelang vs deepgemm vs w8a8_block_fp8_matmul (#4735) · 14269198
  Chunan Zeng authored Mar 24, 2025
  
  14269198
- support cu128 sgl-kernel (#4744) · 9b7cf9ee
  Yineng Zhang authored Mar 24, 2025
  
  9b7cf9ee
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
- Add DeepEP tests into CI (#4737) · 64129fa6
  fzyzcjy authored Mar 25, 2025
  
  64129fa6
- Support FP4 gemm (1/2) (#3899) · e9f8e423
  Trevor Morris authored Mar 24, 2025
  
  e9f8e423
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
- Fix circular imports in gptq.py and unblock test explorer (#4736) · 4c584fc6
  Stefan He authored Mar 24, 2025
  
  4c584fc6
- Fix EAGLE3 for llama3.3 70b (#4716) · 77cf771e
  Ke Bao authored Mar 25, 2025
  
  77cf771e
24 Mar, 2025 9 commits
- [PD] Remove invalid parameter (#4721) · 8154de5a
  Xuchun Shang authored Mar 25, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
```
  8154de5a
- update pyproject (#4731) · c11cfda0
  Yineng Zhang authored Mar 24, 2025
  
  c11cfda0
- Support dynamic version name in sglang's pyproject.toml (#4720) · 64edeb79
  Yuhong Guo authored Mar 24, 2025
  
  64edeb79
- [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396) · 65c24c28
  Chunan Zeng authored Mar 23, 2025
  
  65c24c28
- rename benchmark_deepgemm_fp8_group_gemm.py (#4605) · 3980ff1b
  Tongbao Zhang authored Mar 24, 2025
  
  3980ff1b
- Support FA3 as Attention backend by using `--attention-backend fa3` (#4680) · 5d7edc8e
  Stefan He authored Mar 23, 2025
```
Co-authored-by: qsong <qsong@linkedin.com>
Co-authored-by: qingquansong <ustcsqq@gmail.com>
```
  5d7edc8e
- [ROCm] Enable MTP (NextN) on AMD GPU (#4631) · af6535e7
  Alex Sun authored Mar 24, 2025
  
  af6535e7
- Unify variable naming: replace is_in_free_group with is_not_in_free_group (#4698) · 93cf7fc5
  c1lovez1 authored Mar 24, 2025
  
  93cf7fc5
- Fix RotaryEmbedding when using Triton backend for EXAONE-3.5-2.4B (#4064) · 2a206b22
  Kyungmin Lee authored Mar 24, 2025
  
  2a206b22
23 Mar, 2025 4 commits
- Move mem_state update into debug mode (#4525) · 4d253057
  Zhiqiang Xie authored Mar 23, 2025
  
  4d253057
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
- Support async in DeepEP (#4610) · ca75741e
  fzyzcjy authored Mar 23, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  ca75741e
- Multiple tiny code cleanups (#4608) · c6d549e7
  fzyzcjy authored Mar 23, 2025
  
  c6d549e7
22 Mar, 2025 15 commits
- close gemma2 in test_verl_engine.py temporarily (#4685) · 3c09548d
  Yi Zhang authored Mar 23, 2025
  
  3c09548d
- fix typo SGLang supports three grammar backends (#4679) · 8796cebb
  BroadbentJim authored Mar 22, 2025
  
  8796cebb
- Optimize Permute Kernel in DeepEP (#4643) · c2bd094d
  xutizhou authored Mar 23, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  c2bd094d
- [Bug Fix] Add partial rotary factor support for Phi-4 and upgrade to transformers v4.50.0 (#3984) · f8f9244a
  Adarsh Shirawalmath authored Mar 23, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  f8f9244a
- Bug fix for metrics counter (#4660) · ecbfe58b
  Zhiqiang Xie authored Mar 22, 2025
  
  ecbfe58b
- Add EAGLE mtbench benchmark script (#4676) · 8f163b16
  Ke Bao authored Mar 23, 2025
```
Co-authored-by: chromecast56 <jamesll@mit.edu>
```
  8f163b16
- fix flaky ut (#4670) · e7a8610d
  Yineng Zhang authored Mar 22, 2025
  
  e7a8610d
- [CI fix] test skipping modelopt on AMD (#4677) · a2cc62a6
  Adarsh Shirawalmath authored Mar 23, 2025
  
  a2cc62a6
- [Docs] Update docs for gemma3 and VLM chat templates (#4674) · fb888603
  Adarsh Shirawalmath authored Mar 22, 2025
  
  fb888603
- [1/3] fix dsv3 awq issue (#4556) · 321ab756
  AniZpZ authored Mar 22, 2025
```
Co-authored-by: leoneo <1320612015@qq.com>
```
  321ab756
- Correcting default configuration when benchmarking fused_moe (#4665) · 38f25e87
  penguin_wwy authored Mar 22, 2025
  
  38f25e87
- [quantization] fix channelwise conversion with scalar weight scale (#4596) · 8cd42504
  Yun Dai authored Mar 22, 2025
  
  8cd42504
- Speed up per token and per tensor quant by 15% (#4639) · 6a384d5c
  Chunan Zeng authored Mar 22, 2025
  
  6a384d5c
- update news for README (#4664) · f69e0696
  Yineng Zhang authored Mar 21, 2025
  
  f69e0696
- fix: fix ipython running error for Engine due to outlines nest_asyncio (#4582) · f6ab4ca6
  mlmz authored Mar 22, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  f6ab4ca6
21 Mar, 2025 4 commits
- [PD] Release initial code (#4654) · c7c7dbeb
  Byron Hsu authored Mar 21, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: makro
Co-authored-by: dhou-xai
```
  c7c7dbeb
- Align completion and chat_completion response to OpenAI API (#4637) · 417fc72f
  Yuhong Guo authored Mar 21, 2025
  
  417fc72f
- [docs] Add links and fix grammars in deploy_on_k8s.md (#4641) · c6ec7029
  Michael Yao authored Mar 21, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  c6ec7029
- Set deepgemm to the default value in the hopper architecture. (#4613) · 4c56e5db
  lukec authored Mar 21, 2025
  
  4c56e5db