Commits · defede5073fe39e7a79187a1f85e559a99201ef0 · change / sglang

14 Apr, 2025 1 commit
- Fix DeepSeek DP Attention + torch compile (#5367) · defede50
  fzyzcjy authored Apr 14, 2025
```
Co-authored-by: ispobock <ispobaoke@163.com>
```
  defede50
13 Apr, 2025 1 commit
- feat: update experiment_runner (#5360) · 39d90449
  Yineng Zhang authored Apr 13, 2025
  
  39d90449
12 Apr, 2025 2 commits
- Support server based rollout in Verlengine (#4848) · bc92107b
  tianlian yi authored Apr 13, 2025
```
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jinn <47354855+jhinpan@users.noreply.github.com>
```
  bc92107b
- Adjust ci test threshold (#5271) · 5ad05719
  Ke Bao authored Apr 12, 2025
  
  5ad05719
10 Apr, 2025 1 commit
- Update deps for mllama4 (#5215) · 1078396f
  Ke Bao authored Apr 11, 2025
  
  1078396f
09 Apr, 2025 5 commits
- update grok test (#5171) · 7f875f12
  saienduri authored Apr 09, 2025
  
  7f875f12
- model: support mllama4 (#5144) · fbebcb7a
  Mick authored Apr 10, 2025
  
  fbebcb7a
- [ci] fix ci test fused_moe op (#5102) · 87eddedf
  Xiaoyu Zhang authored Apr 09, 2025
  
  87eddedf
- Support Llama4 fp8 inference (#5194) · 40652482
  HandH1998 authored Apr 09, 2025
```
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>
```
  40652482
- Tiny disable model that does not work (#5175) · 39efad4f
  fzyzcjy authored Apr 09, 2025
  
  39efad4f
08 Apr, 2025 4 commits
- [feat&refactor] Enhance multimodal input support with refactor io_struct (#4938) · d09a51f1
  XinyuanTong authored Apr 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  d09a51f1
- Use public model for FA3 speculative decode testing (#5152) · fd5a55cf
  Yubo Wang authored Apr 08, 2025
  
  fd5a55cf
- Add unit test on page_size > 1 and mla and integration test for Flash Attention 3 (#4760) · 804d9f2e
  Yubo Wang authored Apr 07, 2025
  
  804d9f2e
- [modelopt] automatically inspect if model is ModelOpt quantized and set quantization method (#5145) · 9731eca7
  Yun Dai authored Apr 07, 2025
  
  9731eca7
05 Apr, 2025 1 commit
- [Revision] Replace enable_flashinfer_mla argument with attention_backend (#5052) · efbae697
  Baizhou Zhang authored Apr 05, 2025
  
  efbae697
04 Apr, 2025 1 commit

[2/3] fix dsv3 awq issue (#4625) · d95269f9

AniZpZ authored Apr 04, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>

d95269f9

03 Apr, 2025 2 commits
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
02 Apr, 2025 1 commit
- Large page size aligned hierarchical caching (#4581) · e119f042
  Zhiqiang Xie authored Apr 01, 2025
  
  e119f042
31 Mar, 2025 3 commits
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
- Fix oom error for large page size (#4913) · a169b9f8
  Zhiqiang Xie authored Mar 30, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a169b9f8
- [Fix] Improve Lora tests and reduce CI runtime (#4925) · 42873eac
  Baizhou Zhang authored Mar 30, 2025
  
  42873eac
30 Mar, 2025 3 commits
- Fix 2-gpu CI test and suppress some warnings (#4930) · 9adf178c
  Lianmin Zheng authored Mar 30, 2025
  
  9adf178c
- Fix retract for page size > 1 (#4914) · 4ede6770
  Lianmin Zheng authored Mar 30, 2025
  
  4ede6770
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
28 Mar, 2025 11 commits
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
- [Feature] add multi-rank support for Lora (#4492) · ef9a378a
  chaobo jia authored Mar 29, 2025
```
Co-authored-by: rudy152 <czh1137892874@gmail.com>
```
  ef9a378a
- Fix CI tests (#4853) · 47e6628a
  Lianmin Zheng authored Mar 28, 2025
  
  47e6628a
- test: reduce `mem_fraction_static` for gemma3 vision test (#4840) · 7907f9eb
  Juwan Yoo authored Mar 27, 2025
  
  7907f9eb
- Fix missing arguments in SchedulePolicy and RadixCache initialization in tests. (#4712) · 6dbf9998
  vikram singh shekhawat authored Mar 28, 2025
  
  6dbf9998
- IPv6 support (#3949) · e2e2ab70
  Vincent authored Mar 28, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  e2e2ab70
- Fix CI of test_patch_torch (#4844) · 0d3e3072
  fzyzcjy authored Mar 28, 2025
  
  0d3e3072
- Remove retry in nightly tests (#4846) · 62dd9587
  fzyzcjy authored Mar 28, 2025
  
  62dd9587
- Fix the lora adapter when lora path is none (#4799) · 9fdc6d6a
  Qiaolin Yu authored Mar 28, 2025
```
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
```
  9fdc6d6a
- Include context length in /v1/models response. (#4809) · 04eb6062
  Jon Durbin authored Mar 27, 2025
  
  04eb6062
- Support (1 <= dp < tp) in the dp attention in DeepEP (#4770) · 7f19e083
  tarinkk authored Mar 27, 2025
```
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
```
  7f19e083
27 Mar, 2025 4 commits
- Fix the nightly eval by lowering the threshold of `neuralmagic/gemma-2-2b-it-FP8` (#4830) · 2a882e8f
  Lianmin Zheng authored Mar 27, 2025
  
  2a882e8f
- Patch PyTorch's bug that cross-process tensor transfer will lead to wrong device (#4565) · 92bb49a7
  fzyzcjy authored Mar 27, 2025
  
  92bb49a7
- support clip embedding model (#4506) · c913ed40
  uylnap authored Mar 27, 2025
  
  c913ed40
- Align finish reason and stream mode in openai api (#4388) · 1afe3d07
  Xihuai Wang authored Mar 27, 2025
  
  1afe3d07