- 19 Nov, 2025 1 commit
-
-
Kane authored
Feature: 1. added mlu590 bfloat16, single-gpu and multi-gpus inference. 2. added mlu590 int8 inference.
-
- 13 Nov, 2025 1 commit
-
-
Watebear authored
-
- 07 Nov, 2025 1 commit
-
-
gushiqiao authored
-
- 28 Aug, 2025 1 commit
-
-
gushiqiao authored
* [Feat] Support vae bf16 and add 4090 best config * [Feat] Support vae bf16 and add 4090 best config * [Feat] Support vae bf16 and add 4090 best config * [Feat] Support vae bf16 and add 4090 best config * update dtype --------- Co-authored-by:helloyongyang <yongyang1030@163.com>
-
- 25 Aug, 2025 1 commit
-
-
helloyongyang authored
-
- 22 Jul, 2025 1 commit
-
-
gushiqiao authored
-
- 21 Jul, 2025 1 commit
-
-
gushiqiao authored
-
- 12 Jul, 2025 2 commits
- 11 Jul, 2025 1 commit
-
-
gushiqiao authored
-
- 02 Jul, 2025 1 commit
-
-
gushiqiao authored
Enable 720p model inference on low-spec GPUs/CPUs and accelerate T5/CLIP quantized models with vLLM operators
-
- 09 Jun, 2025 1 commit
-
-
gushiqiao authored
* reconstruct quantization and fix memory leak bug. * Support lazy load inference. * reconstruct quantization * Fix hunyuan bugs * deleted tmp file --------- Co-authored-by:
root <root@pt-c0b333b3a1834e81a0d4d5f412c6ffa1-worker-0.pt-c0b333b3a1834e81a0d4d5f412c6ffa1.ns-devsft-3460edd0.svc.cluster.local> Co-authored-by:
gushiqiao <gushqiaio@sensetime.com> Co-authored-by:
gushiqiao <gushiqiao@sensetime.com>
-
