vllm/engine/arg_utils.py · e3e79e9e8a2224e03a711c3d1ef7a35daa447083 · OpenDAS / vllm_cscc

"vllm/benchmarks/benchmark_throughput.py" did not exist on "728c4c8a063c25e7a20d6eda20a3f30873bda4c6"

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e

arg_utils.py 9.62 KB

Replace arg_utils.py