"git@developer.sourcefind.cn:bw-bestperf/wan2.1-t2v-14b.git" did not exist on "11734ad181887c2cf98f42abfc68cc831c514b4a"
-
Graham King authored
New vllm and sglang engines that run in a sub-process. Will hopefully replace the existing embedded python engines. Why? - Pure Python, does not require knowing Rust to work on it. Much simpler to maintain. - No embedded Python interpreter which avoids linking libpython and avoids the MacOS virtualenv issues. - Should have better performance as it's "native" vllm / sglang. - Works with any version of vllm (including v1!) and sglang. Less upgrade struggle.28fd481c
This project manages its dependencies using Cargo.
Learn more