"vscode:/vscode.git/clone" did not exist on "a8c1d161a7d87dbc6c7cccfce303dcbe2e4ed6be"
Unverified Commit a00d8b23 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

Use float32 for test_completion.py (#22385)


Signed-off-by: default avatarMichael Goin <mgoin64@gmail.com>
parent 04cf435d
......@@ -20,9 +20,8 @@ MODEL_NAME = "facebook/opt-125m"
@pytest.fixture(scope="module")
def default_server_args():
return [
# use half precision for speed and memory savings in CI environment
"--dtype",
"bfloat16",
"float32",
"--max-model-len",
"2048",
"--max-num-seqs",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment