Skip to content

GitLab

Unverified Commit 932c6b74 authored by Robert Shaw's avatar Robert Shaw Committed by GitHub
Browse files

[V1] LM Eval With Streaming Integration Tests (#11590)

parent eaa92d44
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
.buildkite/test-pipeline.yaml
View file @ 932c6b74
...@@ -195,6 +195,9 @@ steps: ...@@ -195,6 +195,9 @@ steps:
# TODO: accuracy does not match, whether setting # TODO: accuracy does not match, whether setting
# VLLM_USE_FLASHINFER_SAMPLER or not on H100. # VLLM_USE_FLASHINFER_SAMPLER or not on H100.
- VLLM_USE_V1=1 pytest -v -s v1/e2e - VLLM_USE_V1=1 pytest -v -s v1/e2e
# Integration test for streaming correctness (requires special branch).
- pip install -U git+https://github.com/robertgshaw2-neuralmagic/lm-evaluation-harness.git@streaming-api
- pytest -v -s entrypoints/openai/test_accuracy.py::test_lm_eval_accuracy_v1_engine
- label: Examples Test # 25min - label: Examples Test # 25min
working_dir: "/vllm-workspace/examples" working_dir: "/vllm-workspace/examples"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment