Commits · 34ef6c8135359d63171765e52df52f3eb05eba72 · change / sglang

"launcher/vscode:/vscode.git/clone" did not exist on "4b1c9720c03609d424469c1b6eb221745fefde4b"

12 Apr, 2025 1 commit
- [VLM] Adopt fast image processor by default (#5065) · 34ef6c81
  Mick authored Apr 12, 2025
  
  34ef6c81
11 Apr, 2025 2 commits
- [fix] fix mrope positions not picked up (#5265) · e53a0b3d
  Mick authored Apr 11, 2025
  
  e53a0b3d
- Optimize attention in llama4 (#5127) · cd7e32e2
  fzyzcjy authored Apr 11, 2025
  
  cd7e32e2
10 Apr, 2025 1 commit
- Fix DeepSeek error when using DeepEP mode (#5190) · e3c4bd31
  fzyzcjy authored Apr 10, 2025
  
  e3c4bd31
09 Apr, 2025 5 commits
- model: support mllama4 (#5144) · fbebcb7a
  Mick authored Apr 10, 2025
  
  fbebcb7a
- Support Llama4 fp8 inference (#5194) · 40652482
  HandH1998 authored Apr 09, 2025
```
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>
```
  40652482
- Optimize topk operation in llama4 (#5128) · 86a876d8
  fzyzcjy authored Apr 09, 2025
  
  86a876d8
- fix: use DeepEPDispatcher on CUDA (#5180) · 90caf06c
  Yineng Zhang authored Apr 08, 2025
  
  90caf06c
- [Fix] DeepEP Compatibility with Low Latency (#5068) · bc3f6db2
  Jinyan Chen authored Apr 09, 2025
```
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  bc3f6db2
08 Apr, 2025 2 commits
- Support 2x8xH100 for Llama 4 (#5159) · 5039d547
  fzyzcjy authored Apr 09, 2025
  
  5039d547
- Fix loading KV quantization scale; Enable modelopt kv cache (#4686) · 2695ab05
  Yun Dai authored Apr 08, 2025
```
Co-authored-by: qingquansong <ustcsqq@gmail.com>
```
  2695ab05
07 Apr, 2025 1 commit

Chang Su authored Apr 07, 2025


Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

f04c80dc

05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
04 Apr, 2025 3 commits
- fix dummy-load deepseekv2 (#4535) · 7ed77d6b
  inkcherry authored Apr 05, 2025
  
  7ed77d6b
- Add DeepSeek V3/R1 shared experts fusion (#4918) · 924ca7c9
  Xiaoyu Zhang authored Apr 04, 2025
  
  924ca7c9
- Small refactor DeepEPDispatcher into subclasses (#4994) · febe21ce
  fzyzcjy authored Apr 04, 2025
  
  febe21ce
03 Apr, 2025 3 commits
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Small refactor DeepEPMode to clean up code a bit (#4992) · 8e10fec9
  fzyzcjy authored Apr 03, 2025
  
  8e10fec9
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
01 Apr, 2025 1 commit

[Feature] Support DeepEP Low Latency (#4767) · 23c764b1

Jinyan Chen authored Apr 02, 2025


Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>

23c764b1

31 Mar, 2025 2 commits
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
- Fix DeepSeek bug causing 2.2% MMLU drop when TP!=DP (#4883) · a303325f
  fzyzcjy authored Mar 31, 2025
```
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  a303325f
30 Mar, 2025 2 commits
- Fix 2-gpu CI test and suppress some warnings (#4930) · 9adf178c
  Lianmin Zheng authored Mar 30, 2025
  
  9adf178c
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
29 Mar, 2025 1 commit
- [Feature] Support FA3 backend for MLA (#4831) · 20c90be2
  Baizhou Zhang authored Mar 28, 2025
  
  20c90be2
28 Mar, 2025 3 commits
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
- [Misc] Fix issues reported by torchfix (#4837) · e84f4ba0
  Brayden Zhong authored Mar 27, 2025
  
  e84f4ba0
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
27 Mar, 2025 2 commits
- gemma3: impl `get_attention_sliding_window_size` for attn init (#4823) · 0bc0bf57
  Juwan Yoo authored Mar 27, 2025
  
  0bc0bf57
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
26 Mar, 2025 3 commits
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
- Support recording experts workload in QWen2-MoE (#4775) · 0d658ac3
  Cheng Wan authored Mar 26, 2025
  
  0d658ac3
- [Fix] Fix unexpected idx bug of Phi-3-small (#4728) · 34e07a65
  Baizhou Zhang authored Mar 25, 2025
  
  34e07a65
25 Mar, 2025 4 commits
- Add endpoints to dump selected expert ids (#4435) · 199bb01d
  yuhsaun-t authored Mar 24, 2025
```
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  199bb01d
- model: Minicpmo (#3023) · 1e86457c
  Mick authored Mar 25, 2025
  
  1e86457c
- [Model] Support Qwen2ForSequenceClassification (#4609) · 22c3702e
  Ximingwang-09 authored Mar 25, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  22c3702e
- Fix EAGLE3 for llama3.3 70b (#4716) · 77cf771e
  Ke Bao authored Mar 25, 2025
  
  77cf771e
23 Mar, 2025 3 commits
- refactor: bug fixes and refactor for vlm (#4661) · 11577ced
  Mick authored Mar 23, 2025
  
  11577ced
- Support async in DeepEP (#4610) · ca75741e
  fzyzcjy authored Mar 23, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  ca75741e
- Multiple tiny code cleanups (#4608) · c6d549e7
  fzyzcjy authored Mar 23, 2025
  
  c6d549e7