Unverified Commit 86fd8bb0 authored by Simon Mo's avatar Simon Mo Committed by GitHub
Browse files

Add warning to prevent changes to benchmark api server (#2858)

parent ab3a5a82
"""
NOTE: This API server is used only for demonstrating usage of AsyncEngine and simple performance benchmarks.
It is not intended for production use. For production use, we recommend using our OpenAI compatible server.
We are also not going to accept PRs modifying this file, please change `vllm/entrypoints/openai/api_server.py` instead.
"""
import argparse import argparse
import json import json
from typing import AsyncGenerator from typing import AsyncGenerator
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment