• ssmi153's avatar
    GPTQ Env vars: catch correct type of error (#596) · 36285595
    ssmi153 authored
    # What does this PR do?
    
    When passing in environment variables like gptq_bits, we still get
    errors thrown from TGI because the try/catch block is catching the wrong
    type of error. This PR aims to fix that.
    
    @Narsil - let me know if this is how you want this formatted. My Python
    is a little shaky, so I hope this syntax is correct.
    36285595
weights.py 6.57 KB