examples/offline_inference_neuron_int8_quantization.py · 008cf886c9361e696f70a15a282d72b58686468a · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Neuron] Adding support for adding/ overriding neuron configuration a… (#8062) · 008cf886
Harsha vardhan manoj Bikki authored Sep 04, 2024
```
Co-authored-by: Harsha Bikki <harbikh@amazon.com>
```
008cf886

offline_inference_neuron_int8_quantization.py 1.82 KB