Needs more testing but good enough for now. I get the same results with this as with `vllm serve`.
Attach a file by drag & drop or click to upload
