- 06 Aug, 2025 1 commit
-
-
gushiqiao authored
-
- 05 Aug, 2025 2 commits
- 22 Jul, 2025 1 commit
-
-
gushiqiao authored
-
- 21 Jul, 2025 1 commit
-
-
gushiqiao authored
-
- 12 Jul, 2025 2 commits
- 11 Jul, 2025 1 commit
-
-
gushiqiao authored
-
- 02 Jul, 2025 1 commit
-
-
gushiqiao authored
Enable 720p model inference on low-spec GPUs/CPUs and accelerate T5/CLIP quantized models with vLLM operators
-
- 09 Jun, 2025 1 commit
-
-
gushiqiao authored
* reconstruct quantization and fix memory leak bug. * Support lazy load inference. * reconstruct quantization * Fix hunyuan bugs * deleted tmp file --------- Co-authored-by:
root <root@pt-c0b333b3a1834e81a0d4d5f412c6ffa1-worker-0.pt-c0b333b3a1834e81a0d4d5f412c6ffa1.ns-devsft-3460edd0.svc.cluster.local> Co-authored-by:
gushiqiao <gushqiaio@sensetime.com> Co-authored-by:
gushiqiao <gushiqiao@sensetime.com>
-
- 22 May, 2025 2 commits
-
-
Xinchi Huang authored
* async offload & context4debug * offload ratio * Merge branch 'main' into xinchi/fix_offload * adding offload ratio * pre-commit --------- Co-authored-by:“de1star” <“843414674@qq.com”>
-
root authored
-
- 14 May, 2025 1 commit
-
-
Xinchi Huang authored
* fix offload * fix offload --------- Co-authored-by:
-
- 29 Apr, 2025 1 commit
-
-
root authored
-
- 20 Apr, 2025 1 commit
-
-
helloyongyang authored
-
