Commits · 3289c1207d238fada989ca1dcd3b948befb870be · change / sglang

"vscode:/vscode.git/clone" did not exist on "52b460feb98740d68b44aaef4d68470170b3c4a6"

04 Apr, 2025 1 commit
- Update the retry count (#5051) · 3289c120
  Yineng Zhang authored Apr 03, 2025
  
  3289c120
03 Apr, 2025 5 commits
- Add LlavaLlamaForCausaLM in MultiModal Processors (#5039) · 69df9761
  Ravi Theja authored Apr 04, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  69df9761
- Revert "Replace enable_flashinfer_mla argument with attention_backend" (#5048) · 74885a84
  Lianmin Zheng authored Apr 03, 2025
  
  74885a84
- Small refactor DeepEPMode to clean up code a bit (#4992) · 8e10fec9
  fzyzcjy authored Apr 03, 2025
  
  8e10fec9
- Replace enable_flashinfer_mla argument with attention_backend (#5005) · e8999b13
  Baizhou Zhang authored Apr 03, 2025
  
  e8999b13
- fix: fix illegal cuda memory access at fused_moe_kernel (#4727) · e41549c3
  saltyfish66 authored Apr 03, 2025
```
Co-authored-by: yuethe <yuethe@tencent.com>
```
  e41549c3
02 Apr, 2025 6 commits
- Update tokenizer_manager.py (#5008) · 31da75ab
  Kaiyu Yang authored Apr 02, 2025
  
  31da75ab
- Add Eagle Speculative Decoding to FA3 Backend (#4951) · e983e432
  Qingquan Song authored Apr 02, 2025
```
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: zcnrex <zcnrex@gmail.com>
```
  e983e432
- sgl scaled_fp8_quant support output padding (#4861) · e9c6ce46
  Xiaoyu Zhang authored Apr 02, 2025
  
  e9c6ce46
- bug fix for hicache host eviction (#4989) · 3fadc647
  Zhiqiang Xie authored Apr 02, 2025
  
  3fadc647
- Large page size aligned hierarchical caching (#4581) · e119f042
  Zhiqiang Xie authored Apr 01, 2025
  
  e119f042
- [VLM RLHF] Take Image input for verl vlm rollout (#4915) · 9eb49e87
  XinyuanTong authored Apr 01, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: GeLee <leege233@gmail.com>
```
  9eb49e87
01 Apr, 2025 4 commits
- Prevent memory leak of retract_decode when page_size > 1 (#4977) · 12047f5e
  Zhiqiang Xie authored Apr 01, 2025
  
  12047f5e
- update bench_serving (#4958) · fda6bb78
  Yineng Zhang authored Apr 01, 2025
  
  fda6bb78
- [Feature] Support DeepEP Low Latency (#4767) · 23c764b1
  Jinyan Chen authored Apr 02, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  23c764b1
- Revert PR 4764 & 4813 related to R1 RoPE (#4959) · 87fafa01
  Yuhong Guo authored Apr 01, 2025
  
  87fafa01
31 Mar, 2025 6 commits
- use fa3 in sgl-kernel (#4954) · 1c63e797
  Yineng Zhang authored Mar 31, 2025
  
  1c63e797
- refactor: multimodal data (#4754) · 5cb552b1
  Mick authored Apr 01, 2025
  
  5cb552b1
- [feat] interface for platforms abstraction (#4928) · 51ac297a
  JieXin Liang authored Mar 31, 2025
  
  51ac297a
- Fix oom error for large page size (#4913) · a169b9f8
  Zhiqiang Xie authored Mar 30, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a169b9f8
- [Fix] Add torch compile for torch.clamp back (#4936) · 4a63bc32
  Baizhou Zhang authored Mar 30, 2025
  
  4a63bc32
- Fix DeepSeek bug causing 2.2% MMLU drop when TP!=DP (#4883) · a303325f
  fzyzcjy authored Mar 31, 2025
```
Co-authored-by: ch-wan <cwan39@gatech.edu>
```
  a303325f
30 Mar, 2025 5 commits
- [Fix] avoid stream sync and torch compile in prefill for fa3 backend (#4932) · e62d60fe
  Baizhou Zhang authored Mar 30, 2025
  
  e62d60fe
- Fix sglang frontend's incorrect dependency on torch (#4931) · 032f8faa
  SEPLOS authored Mar 31, 2025
  
  032f8faa
- Fix 2-gpu CI test and suppress some warnings (#4930) · 9adf178c
  Lianmin Zheng authored Mar 30, 2025
  
  9adf178c
- Fix retract for page size > 1 (#4914) · 4ede6770
  Lianmin Zheng authored Mar 30, 2025
  
  4ede6770
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
29 Mar, 2025 5 commits
- Improve stack trace of retry errors (#4845) · 8690c40b
  fzyzcjy authored Mar 29, 2025
  
  8690c40b
- Fix BadRequestError wrong arguments and remove openai dependency (#4882) · b1cfb4e9
  fzyzcjy authored Mar 29, 2025
  
  b1cfb4e9
- bump v0.4.4.post3 (#4878) · 19e96e59
  Yineng Zhang authored Mar 28, 2025
  
  19e96e59
- upgrade sgl-kernel 0.0.5.post4 (#4873) · d8a136a1
  Yineng Zhang authored Mar 28, 2025
  
  d8a136a1
- [Feature] Support FA3 backend for MLA (#4831) · 20c90be2
  Baizhou Zhang authored Mar 28, 2025
  
  20c90be2
28 Mar, 2025 8 commits
- Make torch compile configurable for biased_grouped_topk (#4749) · 044c3159
  Qingquan Song authored Mar 28, 2025
  
  044c3159
- Fix wrong variable name when stopping memory profile (#4772) · c483377e
  Fr4nk1in authored Mar 29, 2025
  
  c483377e
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
- [Feature] add multi-rank support for Lora (#4492) · ef9a378a
  chaobo jia authored Mar 29, 2025
```
Co-authored-by: rudy152 <czh1137892874@gmail.com>
```
  ef9a378a
- Fix fa3 cuda graph page_size > 1 precision and page_size=1 speed (#4855) · 6ffb6bd4
  Qingquan Song authored Mar 28, 2025
  
  6ffb6bd4
- Fix CI tests (#4853) · 47e6628a
  Lianmin Zheng authored Mar 28, 2025
  
  47e6628a
- Support with_stack and record_shapes in profiler (#4740) · 8c04f0f2
  fzyzcjy authored Mar 28, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  8c04f0f2
- Super tiny remove unused code (#4750) · 265e7564
  fzyzcjy authored Mar 28, 2025
  
  265e7564