Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
Commits
0b6807ca
Unverified
Commit
0b6807ca
authored
Mar 03, 2023
by
OlivierDehaene
Committed by
GitHub
Mar 03, 2023
Browse files
feat(server): fix transformers commit (#96)
parent
240c4187
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
9 additions
and
7 deletions
+9
-7
.github/workflows/tests.yaml
.github/workflows/tests.yaml
+1
-1
Makefile
Makefile
+1
-1
server/Makefile
server/Makefile
+7
-5
No files found.
.github/workflows/tests.yaml
View file @
0b6807ca
...
@@ -60,7 +60,7 @@ jobs:
...
@@ -60,7 +60,7 @@ jobs:
-
name
:
Run server tests
-
name
:
Run server tests
run
:
|
run
:
|
pip install pytest
pip install pytest
pytest -sv server/tests
HF_HUB_ENABLE_HF_TRANSFER=1
pytest -sv server/tests
-
name
:
Run Rust tests
-
name
:
Run Rust tests
run
:
|
run
:
|
cargo test
cargo test
...
...
Makefile
View file @
0b6807ca
...
@@ -19,7 +19,7 @@ integration-tests: install-router install-launcher
...
@@ -19,7 +19,7 @@ integration-tests: install-router install-launcher
cargo
test
cargo
test
python-tests
:
python-tests
:
cd
server
&&
pytest tests
cd
server
&&
HF_HUB_ENABLE_HF_TRANSFER
=
1
pytest tests
run-bloom-560m
:
run-bloom-560m
:
text-generation-launcher
--model-id
bigscience/bloom-560m
--num-shard
2
text-generation-launcher
--model-id
bigscience/bloom-560m
--num-shard
2
...
...
server/Makefile
View file @
0b6807ca
transformers_commit
:=
712d62e83c28236c7f39af690e7792a54288dbd9
gen-server
:
gen-server
:
# Compile protos
# Compile protos
pip
install
grpcio-tools
==
1.51.1
--no-cache-dir
pip
install
grpcio-tools
==
1.51.1
--no-cache-dir
...
@@ -10,11 +12,11 @@ install-transformers:
...
@@ -10,11 +12,11 @@ install-transformers:
# Install specific version of transformers with custom cuda kernels
# Install specific version of transformers with custom cuda kernels
pip uninstall transformers
-y
||
true
pip uninstall transformers
-y
||
true
rm
-rf
transformers
||
true
rm
-rf
transformers
||
true
rm
-rf
transformers-
text_generation_inference
||
true
rm
-rf
transformers-
$(transformers_commit)
||
true
curl
-L
-O
https://github.com/OlivierDehaene/transformers/archive/
refs/heads/text_generation_inference
.zip
curl
-L
-O
https://github.com/OlivierDehaene/transformers/archive/
$(transformers_commit)
.zip
unzip
text_generation_inference
.zip
unzip
$(transformers_commit)
.zip
rm
text_generation_inference
.zip
rm
$(transformers_commit)
.zip
mv
transformers-
text_generation_inference
transformers
mv
transformers-
$(transformers_commit)
transformers
cd
transformers
&&
python setup.py
install
cd
transformers
&&
python setup.py
install
install-torch
:
install-torch
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment