Unverified Commit 71799fd0 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[CI Failure] Fix OOM with test_oot_registration_embedding (#20144)


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent e9fd658a
......@@ -53,7 +53,9 @@ def test_oot_registration_embedding(
with monkeypatch.context() as m:
m.setenv("VLLM_PLUGINS", "register_dummy_model")
prompts = ["Hello, my name is", "The text does not matter"]
llm = LLM(model=dummy_gemma2_embedding_path, load_format="dummy")
llm = LLM(model=dummy_gemma2_embedding_path,
load_format="dummy",
max_model_len=2048)
outputs = llm.embed(prompts)
for output in outputs:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment