• Qubitium-ModelCloud's avatar
    Add GPTQModel support for evaluating GPTQ models (#2217) · 4f8e479e
    Qubitium-ModelCloud authored
    
    
    * support gptqmodel
    
    * code opt
    
    * add gptqmodel option
    
    * Update huggingface.py
    
    * Update pyproject.toml
    
    * gptqmodel version upgraded to 1.0.6
    
    * GPTQModel version upgraded to 1.0.8
    
    * Update pyproject.toml
    
    * fix ruff-format error
    
    * add gptqmodel test
    
    * Update gptqmodel test model
    
    * skip cuda
    
    * python3.8 compatible
    
    * Update README.md
    
    * Update README.md
    
    ---------
    Co-authored-by: default avatarCL-ModelCloud <cl@modelcloud.ai>
    4f8e479e
pyproject.toml 2.93 KB