Commits · 89ccb533ad390d9cf9c75dacf6eec4130901aede · change / sglang

09 Mar, 2025 1 commit
- use sgl-kernel 0.0.4 (#4224) · 89ccb533
  Yineng Zhang authored Mar 08, 2025
  
  89ccb533
07 Mar, 2025 1 commit
- use same version for ci and pyproject (#4187) · 70866b6f
  Yineng Zhang authored Mar 07, 2025
  
  70866b6f
06 Mar, 2025 1 commit
- [docs] fix HF reference script command (#4148) · 19fd57bc
  Adarsh Shirawalmath authored Mar 07, 2025
  
  19fd57bc
03 Mar, 2025 3 commits
- Share target model embed and head weights for nextn (#4033) · 9fafa62d
  Ke Bao authored Mar 04, 2025
  
  9fafa62d
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
27 Feb, 2025 1 commit
- upgrade flashinfer v0.2.2.post1 (#3934) · 564bdf29
  Yineng Zhang authored Feb 27, 2025
  
  564bdf29
24 Feb, 2025 1 commit
- Fix pandas dependency in CI (#3818) · c9745ee0
  Lianmin Zheng authored Feb 24, 2025
  
  c9745ee0
17 Feb, 2025 1 commit
- chore: update flashinfer v0.2.1.post2 (#3644) · 75d171a9
  Yineng Zhang authored Feb 18, 2025
  
  75d171a9
15 Feb, 2025 1 commit
- [CI] Improve Docs CI Efficiency (#3587) · 7443197a
  Shi Shuai authored Feb 15, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  7443197a
14 Feb, 2025 2 commits
- Support NextN (MTP) speculative decoding for DeepSeek-V3/R1 (#3582) · 862dd76c
  Ke Bao authored Feb 15, 2025
  
  862dd76c
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
09 Feb, 2025 1 commit
- remove cutex dependency (#3422) · 4d2dbeac
  Yineng Zhang authored Feb 09, 2025
  
  4d2dbeac
04 Feb, 2025 1 commit
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
25 Jan, 2025 1 commit
- Update whl index path (#3128) · c23d5706
  Ke Bao authored Jan 25, 2025
  
  c23d5706
24 Jan, 2025 2 commits
- Add step to update sgl-kernel whl index (#3110) · 665e5e85
  Ke Bao authored Jan 25, 2025
  
  665e5e85
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
20 Jan, 2025 1 commit
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
19 Jan, 2025 1 commit
- [router] Allow empty worker list for sglang.launch_router (#2979) · ef18b0ed
  Byron Hsu authored Jan 19, 2025
  
  ef18b0ed
17 Jan, 2025 1 commit
- update ci install dependency (#2949) · d06c1ab5
  Yineng Zhang authored Jan 17, 2025
  
  d06c1ab5
15 Jan, 2025 1 commit
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
13 Jan, 2025 1 commit
- CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630) · 923f5183
  fzyzcjy authored Jan 14, 2025
  
  923f5183
08 Jan, 2025 1 commit
- Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784) · 8a690612
  Lianmin Zheng authored Jan 07, 2025
```
Co-authored-by: SangBin Cho rkooo567@gmail.com
```
  8a690612
05 Jan, 2025 1 commit
- fix lint (#2733) · bc6ad367
  Yineng Zhang authored Jan 05, 2025
  
  bc6ad367
03 Jan, 2025 1 commit
- feat: Support VLM in reference_hf (#2726) · f5d0865b
  Ce Gao authored Jan 03, 2025
```
Signed-off-by: Ce Gao <gaocegege@hotmail.com>
```
  f5d0865b
31 Dec, 2024 2 commits
- feat: use CUDA 12.4 by default (for FA3) (#2682) · d49b13c6
  Yineng Zhang authored Dec 31, 2024
  
  d49b13c6
- CI: Update scripts to fail fast (#2672) · f7074700
  fzyzcjy authored Dec 31, 2024
  
  f7074700
19 Dec, 2024 1 commit
- fix followup #2517 (#2524) · d95a5f5b
  Yineng Zhang authored Dec 19, 2024
  
  d95a5f5b
17 Dec, 2024 1 commit
- Clean up GPU memory after killing sglang processes (#2457) · ce094a5d
  Ata Fatahi authored Dec 17, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  ce094a5d
16 Dec, 2024 1 commit
- minor: update flashinfer nightly (#2490) · 7154b4b1
  Yineng Zhang authored Dec 16, 2024
  
  7154b4b1
09 Dec, 2024 1 commit
- Migrate llama_classification to use the /classify interface (#2417) · 835f8afc
  Lianmin Zheng authored Dec 08, 2024
  
  835f8afc
08 Dec, 2024 1 commit
- Update killall_sglang.sh (#2397) · 96db0f66
  Lianmin Zheng authored Dec 08, 2024
  
  96db0f66
07 Dec, 2024 1 commit
- minor: update killall script (#2391) · 75ae9689
  Yineng Zhang authored Dec 08, 2024
  
  75ae9689
01 Dec, 2024 4 commits
- minor: rm unused _grouped_size_compiled_for_decode_kernels (#2299) · 3dbd73d3
  Yineng Zhang authored Dec 01, 2024
  
  3dbd73d3
- minor: support flashinfer nightly (#2295) · fc78640e
  Yineng Zhang authored Dec 01, 2024
  
  fc78640e
- feat: add should_use_tensor_core (#2179) · 118b6af3
  Yineng Zhang authored Dec 01, 2024
  
  118b6af3
- [CI] Balance CI tests (#2293) · 9449a954
  Lianmin Zheng authored Dec 01, 2024
  
  9449a954
30 Nov, 2024 1 commit
- [CI] Kill zombie processes (#2280) · 0d6a49bd
  Lianmin Zheng authored Nov 30, 2024
  
  0d6a49bd
29 Nov, 2024 1 commit
- chore: bump v0.3.6.post3 (#2259) · fae4e5e9
  Yineng Zhang authored Nov 30, 2024
  
  fae4e5e9
25 Nov, 2024 1 commit
- [feat] Refactor session control interface and add CI (#2173) · e1e595d7
  Ying Sheng authored Nov 25, 2024
  
  e1e595d7