Commits · 2db4469808158700036de79bd41a9c463bb89bdc · change / sglang · GitLab

04 Dec, 2024 4 commits
- minor: limit the range of vllm versions (#2350) · 2db44698
  Yineng Zhang authored Dec 05, 2024
  
  2db44698
- Check gpu availability at server args creation (#2340) · ed45e509
  Ata Fatahi authored Dec 04, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  ed45e509
- MLA prefill w/o weight absorption (#2349) · ec52464d
  Ke Bao authored Dec 05, 2024
  
  ec52464d
- Adding SGLang FP8 Utils (#2348) · b2986d7a
  HAI authored Dec 04, 2024
  
  b2986d7a
03 Dec, 2024 7 commits
- chore: bump v0.4.0 (#2338) · f8b03269
  Yineng Zhang authored Dec 04, 2024
  
  f8b03269
- Fix gptq for moe layers (#2300) · 1228f7ca
  Lianmin Zheng authored Dec 03, 2024
```
Co-authored-by: root <me@zhyncs.com>
```
  1228f7ca
- Improve torch compile for fused moe (#2327) · 07ec07ad
  Lianmin Zheng authored Dec 03, 2024
  
  07ec07ad
- Revert "[feat] Enable chunked prefill for llava-onevision" (#2329) · aa47f642
  Ying Sheng authored Dec 02, 2024
  
  aa47f642
- [Minor] Fix logger and style (#2325) · 3ddb1c46
  Lianmin Zheng authored Dec 02, 2024
  
  3ddb1c46
- [feat] Enable chunked prefill for llava-onevision (#2281) · 480e38a7
  Ying Sheng authored Dec 02, 2024
  
  480e38a7
- Relax to include more AMD GPUs (#2319) · 69e2d4fb
  HAI authored Dec 02, 2024
  
  69e2d4fb
02 Dec, 2024 5 commits
- Update model_loader deps and qqq quantization deps (#2220) (#2318) · 85e1a6f3
  Yineng Zhang authored Dec 02, 2024
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  85e1a6f3
- [Minor] Fix code style (#2311) · 18108abe
  Lianmin Zheng authored Dec 02, 2024
  
  18108abe
- Use rocminfo instead of rocm-smi for more OS/WSL support (#2310) · c54bda30
  HAI authored Dec 02, 2024
  
  c54bda30
- [Fix] Fix the padded hash value for image tokens (#2309) · 3c79ad35
  Lianmin Zheng authored Dec 01, 2024
  
  3c79ad35
- Online weight updates from torch.distributed (#2279) · 983bfcf3
  Chayenne authored Dec 01, 2024
  
  983bfcf3
01 Dec, 2024 11 commits
- Fix logprob for completions (#2301) · 5c18a037
  Lianmin Zheng authored Dec 01, 2024
  
  5c18a037
- Add a simple torch native attention backend (#2241) · 62c516ac
  Qun Yang authored Dec 01, 2024
  
  62c516ac
- minor: support flashinfer nightly (#2295) · fc78640e
  Yineng Zhang authored Dec 01, 2024
  
  fc78640e
- Feat: upgrade outlines & support compatibility with the old version (#2292) · 906d795f
  gobraves authored Dec 01, 2024
  
  906d795f
- feat: add should_use_tensor_core (#2179) · 118b6af3
  Yineng Zhang authored Dec 01, 2024
  
  118b6af3
- Fix chunked prefill when ignore eos (#2290) · 5f12f0e7
  Liangsheng Yin authored Dec 01, 2024
  
  5f12f0e7
- adapt vllm distributed module to sglang (#2244) · d5b95cbb
  yizhang2077 authored Dec 01, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d5b95cbb
- Revert "Revert "[FEAT] Support GGUF format"" (#2287) · 4936be8a
  Lianmin Zheng authored Nov 30, 2024
  
  4936be8a
- Revert "[Fix] fix assertion error for chunked prefill when disabling cache" (#2286) · f5b5f2bf
  Lianmin Zheng authored Nov 30, 2024
  
  f5b5f2bf
- Revert "[FEAT] Support GGUF format" (#2285) · 7e4c6dd8
  Lianmin Zheng authored Nov 30, 2024
  
  7e4c6dd8
- [Fix] fix assertion error for chunked prefill when disabling cache (#2282) · d622851d
  Rui Wang authored Dec 01, 2024
  
  d622851d
30 Nov, 2024 6 commits
- [FEAT] Support GGUF format (#2215) · 883c9554
  Yang Zheng authored Nov 30, 2024
```
Co-authored-by: Yang Zheng(SW)(Alex) <you@example.com>
```
  883c9554
- [CI] Print summary on github actions (#2274) · ccaf1f99
  Lianmin Zheng authored Nov 29, 2024
  
  ccaf1f99
- Add get weights by parameter name for llama (#2266) · 7d1485d3
  Chayenne authored Nov 29, 2024
  
  7d1485d3
- udate weights from disk (#2265) · 7d5d1d3d
  Chayenne authored Nov 29, 2024
  
  7d5d1d3d
- Support LoRA in Completion API (#2243) · 01017d4c
  bjmsong authored Nov 30, 2024
```
Co-authored-by: root <bjmsong@126.com>
```
  01017d4c
- Fix the default chunked prefill size (#2268) · 94e167ea
  Lianmin Zheng authored Nov 29, 2024
  
  94e167ea
29 Nov, 2024 7 commits
- [benchmark] Add fused_moe_triton benchmark and tuning tools (#2225) · 262e370f
  Xiaoyu Zhang authored Nov 30, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
```
  262e370f
- chore: bump v0.3.6.post3 (#2259) · fae4e5e9
  Yineng Zhang authored Nov 30, 2024
  
  fae4e5e9
- [Minor] fix the style for multimodal models (#2257) · afe1e465
  Lianmin Zheng authored Nov 29, 2024
  
  afe1e465
- Fix hash collision for multi modal models (#2256) · f50a6cf4
  Lianmin Zheng authored Nov 29, 2024
  
  f50a6cf4
- Simplify tokenizer manager (#2254) · fe97a2d4
  Lianmin Zheng authored Nov 29, 2024
  
  fe97a2d4
- Revert "Revert "Add simple CPU offloading support"" (#2253) · 8b48496a
  Ying Sheng authored Nov 28, 2024
```
Co-authored-by: Jani Monoses <jani.monoses@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  8b48496a
- Revert "Add simple CPU offloading support" (#2252) · 4057ea82
  Ying Sheng authored Nov 28, 2024
```
We'll re-add the commit to correctly ack Kaichao's authorship
```
  4057ea82