Skip to content

GitLab

Unverified Commit a00d8b23 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

Use float32 for test_completion.py (#22385) 


Signed-off-by: default avatarMichael Goin <mgoin64@gmail.com>
parent 04cf435d
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 2 deletions
tests/v1/entrypoints/openai/test_completion.py
View file @ a00d8b23
...@@ -20,9 +20,8 @@ MODEL_NAME = "facebook/opt-125m" ...@@ -20,9 +20,8 @@ MODEL_NAME = "facebook/opt-125m"
@pytest.fixture(scope="module") @pytest.fixture(scope="module")
def default_server_args(): def default_server_args():
return [ return [
# use half precision for speed and memory savings in CI environment
"--dtype", "--dtype",
"bfloat16", "float32",
"--max-model-len", "--max-model-len",
"2048", "2048",
"--max-num-seqs", "--max-num-seqs",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment