Skip to content

GitLab

Unverified Commit de2cdeca authored by Daniël de Kok's avatar Daniël de Kok Committed by GitHub
Browse files

nix: add punica-kernels (#2477) 

Enables LoRA support.
parent e4ab8554
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 3 deletions
flake.lock
View file @ de2cdeca
...@@ -944,11 +944,11 @@ ...@@ -944,11 +944,11 @@
"nixpkgs": "nixpkgs_6" "nixpkgs": "nixpkgs_6"
}, },
"locked": { "locked": {
"lastModified": 1724784743, "lastModified": 1725011596,
"narHash": "sha256-NdEoWeNwR/ZstYnHaiQWIYZvr7VsrAh7g3+ZHUPrxuI=", "narHash": "sha256-zfq8lOXFgJnKxxsqSelHuKUvhxgH3cEmLoAgsOO62Cg=",
"owner": "danieldk", "owner": "danieldk",
"repo": "tgi-nix", "repo": "tgi-nix",
"rev": "c9580c3e39a855246bb87b584bbea1885b44f524", "rev": "717c2b07e38538abf05237cca65b2d1363c2c9af",
"type": "github" "type": "github"
}, },
"original": { "original": {
......
nix/server.nix
View file @ de2cdeca
...@@ -26,6 +26,7 @@ ...@@ -26,6 +26,7 @@
opentelemetry-instrumentation-grpc, opentelemetry-instrumentation-grpc,
opentelemetry-semantic-conventions, opentelemetry-semantic-conventions,
peft, peft,
punica-kernels,
safetensors, safetensors,
tokenizers, tokenizers,
torch, torch,
...@@ -92,6 +93,7 @@ buildPythonPackage { ...@@ -92,6 +93,7 @@ buildPythonPackage {
opentelemetry-instrumentation-grpc opentelemetry-instrumentation-grpc
opentelemetry-semantic-conventions opentelemetry-semantic-conventions
peft peft
punica-kernels
safetensors safetensors
sentencepiece sentencepiece
tokenizers tokenizers
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment