server/text_generation_server/utils/gptq/quantize.py · 08b8eec1d749f402d5d560d3c4cc09916320927b · OpenDAS / text-generation-inference · GitLab

Find file Blame History Permalink

fix(server): Fixing non parameters in quantize script `bigcode/starcoder` was an example. (#661) · 08b8eec1
Nicolas Patry authored Jul 20, 2023

08b8eec1

quantize.py 30.2 KB