Commits · 481f608b8ec1528eac6ad427f941a86a82eab2a7 · zhaoyu6 / sglang · GitLab

12 Mar, 2025 2 commits
- Add INT8 support MTP NextN function (#3911) · 481f608b
  lambert0312 authored Mar 12, 2025
  
  481f608b
- unify is_cuda and is_hip (#4321) · d1da58e2
  Yineng Zhang authored Mar 11, 2025
  
  d1da58e2
05 Mar, 2025 1 commit
- [QUANT] Add GPTQModel Dynamic Quantization + `lm_head` Quantization (#3790) · 56a724eb
  Qubitium-ModelCloud authored Mar 05, 2025
```
Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>
```
  56a724eb
03 Mar, 2025 1 commit
- Share target model embed and head weights for nextn (#4033) · 9fafa62d
  Ke Bao authored Mar 04, 2025
  
  9fafa62d
14 Feb, 2025 1 commit
- Support NextN (MTP) speculative decoding for DeepSeek-V3/R1 (#3582) · 862dd76c
  Ke Bao authored Feb 15, 2025
  
  862dd76c