Commits · fc91d08a8f0ef6458bc640bee4de7cf06234f098 · zhaoyu6 / sglang

"official/vision/tasks/retinanet.py" did not exist on "c2e19c978e7a5a9de1c4888754fe92feada241ce"

05 Mar, 2025 2 commits
- [Revision] Add fast decode plan for flashinfer mla (#4012) · fc91d08a
  Baizhou Zhang authored Mar 05, 2025
  
  fc91d08a
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
03 Mar, 2025 4 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
- Revert "Add fast decode plan for flashinfer mla" (#4008) · 9e1014cf
  Lianmin Zheng authored Mar 02, 2025
  
  9e1014cf
- Add fast decode plan for flashinfer mla (#3987) · fa561067
  Baizhou Zhang authored Mar 02, 2025
  
  fa561067
18 Feb, 2025 1 commit
- Fix draft decode max batch size (#3676) · e5ce395a
  Ke Bao authored Feb 18, 2025
  
  e5ce395a
11 Feb, 2025 1 commit
- Support Eagle cuda graph for Triton backend (#3500) · 7e6d5fc6
  Ke Bao authored Feb 12, 2025
  
  7e6d5fc6
10 Feb, 2025 1 commit
- Support Eagle2 for Triton backend (#3466) · 2d611323
  Ke Bao authored Feb 10, 2025
  
  2d611323
05 Feb, 2025 2 commits
- Support custom mask for Triton attention (#3317) · a322051e
  Ke Bao authored Feb 06, 2025
  
  a322051e
- Update Triton extend backend interface (#3309) · de553334
  Ke Bao authored Feb 05, 2025
  
  de553334
04 Feb, 2025 1 commit
- Update Triton decode backend interface (#3292) · a07364cc
  Ke Bao authored Feb 04, 2025
  
  a07364cc
16 Jan, 2025 1 commit
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
02 Jan, 2025 1 commit
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
31 Dec, 2024 1 commit
- Support target model verification in the attention backend (#2678) · f44d1439
  Lianmin Zheng authored Dec 30, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  f44d1439
09 Dec, 2024 1 commit
- [Minor] Improve code style (#2422) · 641b7d0a
  Lianmin Zheng authored Dec 09, 2024
  
  641b7d0a
08 Dec, 2024 2 commits
- Remove unused vars in the triton backend (#2401) · 61dec545
  Ke Bao authored Dec 08, 2024
  
  61dec545
- Optimize Triton decoding kernel for long context (#2394) · 7dc66fcb
  Ke Bao authored Dec 08, 2024
  
  7dc66fcb
04 Dec, 2024 1 commit
- MLA prefill w/o weight absorption (#2349) · ec52464d
  Ke Bao authored Dec 05, 2024
  
  ec52464d
20 Nov, 2024 1 commit
- Enable overlap scheduler by default for the triton attention backend (#2105) · 722530fa
  Lianmin Zheng authored Nov 20, 2024
  
  722530fa
18 Nov, 2024 1 commit
- Simplify flashinfer indices update for prefill (#2074) · 4af3f889
  Lianmin Zheng authored Nov 18, 2024
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: kavioyu <kavioyu@gmail.com>
```
  4af3f889
17 Nov, 2024 1 commit
- Launch dp ranks in parallel (#2053) · f719d9ae
  Lianmin Zheng authored Nov 16, 2024
```
Co-authored-by: Haotian Liu <6631389+haotian-liu@users.noreply.github.com>
```
  f719d9ae
16 Nov, 2024 1 commit
- Support DP MLA (#1970) · 976bc302
  Ke Bao authored Nov 16, 2024
  
  976bc302
24 Oct, 2024 2 commits
- Re-introduce `get_cuda_graph_seq_len_fill_value` (#1783) · 384d85ba
  Lianmin Zheng authored Oct 24, 2024
  
  384d85ba
- [Fix] Fix cuda graph padding for triton attention backend (#1782) · fc82f5a7
  Lianmin Zheng authored Oct 24, 2024
  
  fc82f5a7
21 Oct, 2024 2 commits
- Llama3.2 vision model support (#1551) · 94cde109
  Liangsheng Yin authored Oct 21, 2024
  
  94cde109
- Maintain seq_lens_sum to make more FlashInfer operations non-blocking (#1741) · 09603c6d
  Lianmin Zheng authored Oct 21, 2024
  
  09603c6d
18 Oct, 2024 1 commit
- Simplify flashinfer utilities (#1704) · 6d0fa73e
  Lianmin Zheng authored Oct 17, 2024
  
  6d0fa73e
12 Oct, 2024 1 commit
- [Feature, Hardware] Enable SGLang on XPU GPUs via PyTorch (#1480) · 5d638c92
  Zhang, Liangang authored Oct 13, 2024
  
  5d638c92
30 Sep, 2024 1 commit
- Organize Attention Backends (#1547) · 99ec439d
  Liangsheng Yin authored Sep 30, 2024
  
  99ec439d