Commits · 83452dbb4a19c6a2461e972eb2b64a2df9a466b8 · zhaoyu6 / sglang

18 Jan, 2025 1 commit

[Feature] Support minicpmv v2.6 (#2785) · 3d93f84a

Mick authored Jan 19, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>

3d93f84a

17 Jan, 2025 1 commit
- Enable CPU device on SGLang (#2806) · 63051738
  Chunyuan WU authored Jan 17, 2025
  
  63051738
16 Jan, 2025 2 commits
- Improve type annotation and styles (#2926) · bc6915e3
  Lianmin Zheng authored Jan 16, 2025
  
  bc6915e3
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
15 Jan, 2025 1 commit
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
06 Jan, 2025 1 commit
- Clean up eagle code (#2756) · b8574f69
  Lianmin Zheng authored Jan 06, 2025
  
  b8574f69
02 Jan, 2025 1 commit
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
31 Dec, 2024 1 commit
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37
29 Dec, 2024 1 commit
- Clean up wrapper in flashinfer backend (#2638) · 3815b23c
  Lianmin Zheng authored Dec 29, 2024
  
  3815b23c
27 Dec, 2024 1 commit
- [FIX] Update EOS from config (#2475) · 7a7ac6be
  Yang Zheng authored Dec 28, 2024
  
  7a7ac6be
22 Dec, 2024 1 commit
- [Misc] Fix metrics, weight update lock, request logging (#2543) · 84967019
  Lianmin Zheng authored Dec 22, 2024
  
  84967019
16 Dec, 2024 1 commit
- Simplify pytorch sampling kernel and logit processor (#2491) · 7a1aecb9
  Lianmin Zheng authored Dec 16, 2024
  
  7a1aecb9
11 Dec, 2024 1 commit
- [Core] in batch prefix caching by delay scheduling (#2442) · 9208618b
  SangBin Cho authored Dec 11, 2024
  
  9208618b
09 Dec, 2024 2 commits
- [feat] Enable chunked prefill for llava-onevision (#2412) · 8586b72d
  Ying Sheng authored Dec 09, 2024
  
  8586b72d
- [Minor] Improve code style (#2422) · 641b7d0a
  Lianmin Zheng authored Dec 09, 2024
  
  641b7d0a
08 Dec, 2024 1 commit
- Simplify stream_output (#2398) · a6ca736c
  Lianmin Zheng authored Dec 08, 2024
  
  a6ca736c
06 Dec, 2024 1 commit
- Resubmit MoE-EP (#2371) · 3d32e4a3
  xiaobochen authored Dec 06, 2024
  
  3d32e4a3
03 Dec, 2024 2 commits
- Revert "[feat] Enable chunked prefill for llava-onevision" (#2329) · aa47f642
  Ying Sheng authored Dec 02, 2024
  
  aa47f642
- [feat] Enable chunked prefill for llava-onevision (#2281) · 480e38a7
  Ying Sheng authored Dec 02, 2024
  
  480e38a7
01 Dec, 2024 1 commit
- Add a simple torch native attention backend (#2241) · 62c516ac
  Qun Yang authored Dec 01, 2024
  
  62c516ac
29 Nov, 2024 2 commits
- [Minor] fix the style for multimodal models (#2257) · afe1e465
  Lianmin Zheng authored Nov 29, 2024
  
  afe1e465
- Fix hash collision for multi modal models (#2256) · f50a6cf4
  Lianmin Zheng authored Nov 29, 2024
  
  f50a6cf4
28 Nov, 2024 2 commits
- [fix] Fix prefix caching for multi-image/video (#2239) · b7038fec
  Ying Sheng authored Nov 28, 2024
  
  b7038fec
- Fix memory leak during abort (#2238) · b2ccf36d
  Lianmin Zheng authored Nov 28, 2024
  
  b2ccf36d
27 Nov, 2024 1 commit
- [feat] Support session control for vision language models (#2210) · 37c8a576
  Ying Sheng authored Nov 27, 2024
  
  37c8a576
26 Nov, 2024 1 commit
- Input_embeds support (#2052) · 1aea19f6
  Rin Intachuen authored Nov 25, 2024
  
  1aea19f6
24 Nov, 2024 3 commits
- Fix mixed chunked prefill in overlap mode (#2158) · 731146f6
  Lianmin Zheng authored Nov 24, 2024
  
  731146f6
- Update CI threshold & Improve code style (#2159) · 5652c565
  Lianmin Zheng authored Nov 24, 2024
  
  5652c565
- Simplify batch update (#2154) · c211e7b6
  Lianmin Zheng authored Nov 24, 2024
  
  c211e7b6
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
20 Nov, 2024 2 commits
- [feat] Add session control (#2073) · 5942dfc0
  Ying Sheng authored Nov 20, 2024
  
  5942dfc0
- Enable overlap by default (#2067) · 7d671e4a
  Lianmin Zheng authored Nov 19, 2024
  
  7d671e4a
19 Nov, 2024 3 commits
- Make constrained decoding work for overlap scheduler (#2095) · ffd20fcd
  Lianmin Zheng authored Nov 19, 2024
  
  ffd20fcd
- Use cuda event wait and synchronization instead of busy waiting (#2089) · b7a065ea
  Lianmin Zheng authored Nov 19, 2024
  
  b7a065ea
- Simplify logits penalizer (#2086) · b1104538
  Lianmin Zheng authored Nov 18, 2024
  
  b1104538
18 Nov, 2024 3 commits
- Fix cuda illegal memory access in overlap mode (#2070) · 11668533
  Lianmin Zheng authored Nov 17, 2024
  
  11668533
- Rename arguments `--disable-nan-detection` to `--enable-nan-detection` (#2066) · ebaa2f31
  Lianmin Zheng authored Nov 17, 2024
  
  ebaa2f31
- Support cuda graph for DP attention (#2061) · 62832bb2
  Ke Bao authored Nov 18, 2024
  
  62832bb2
17 Nov, 2024 1 commit
- Fix illegal memory access in overlap mode & Use more fused triton kernels for... · edad3731
  Lianmin Zheng authored Nov 16, 2024
```
Fix illegal memory access in overlap mode & Use more fused triton kernels for building meta data (#2051)
```
  edad3731
16 Nov, 2024 1 commit
- Support DP MLA (#1970) · 976bc302
  Ke Bao authored Nov 16, 2024
  
  976bc302