benchmarks/benchmark_latency.py · 0967102c6de874902d973f0bcb98d48149a8eb49 · OpenDAS / vllm_cscc

"vllm/zero_overhead/v1/eagle.py" did not exist on "c6b636f9fbfd0308ee8d883afd8ccd7ef823eb25"

Implement AWQ quantization support for LLaMA (#1032) · e3e79e9e

Woosuk Kwon authored Sep 16, 2023


Co-authored-by: Robert Irvine <robert@seamlessml.com>
Co-authored-by: root <rirv938@gmail.com>
Co-authored-by: Casper <casperbh.96@gmail.com>
Co-authored-by: julian-q <julianhquevedo@gmail.com>

e3e79e9e

benchmark_latency.py 3.17 KB

Replace benchmark_latency.py