vllm/envs.py · a3bbbfa1d8c2f30581d37c6f30429d648bbbf87c · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Frontend] Warn if user `max_model_len` is greater than derived `max_model_len` (#7080) · 825b0448
Jeff Fialho authored Aug 03, 2024
```
Signed-off-by: Jefferson Fialho <jfialho@ibm.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
```
825b0448

envs.py 13.2 KB