"git@developer.sourcefind.cn:renzhc/diffusers_dcu.git" did not exist on "b2e2d1411ce394ef15c41aafb34b3c08beedff0f"
nix: add default package (#2453)
The default package wraps the launcher and puts the server/router in the path. As a result, TGI can be started using something like: ``` nix run .# -- \ --model-id hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 \ --port 8080 ```
Showing
Please register or sign in to comment