Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
__init__.py 318 Bytes
Newer Older
Casper Hansen's avatar
Refactor model class. Add LLaMa support (LLaMa-2, Vicuna, etc).  
Casper Hansen committed
1 
from .mpt import MptAWQForCausalLM
Casper Hansen's avatar
Add OPT support  
Casper Hansen committed
2 
from .llama import LlamaAWQForCausalLM
Casper Hansen's avatar
Support Falcon 7B+40B  
Casper Hansen committed
3 
from .opt import OptAWQForCausalLM
Casper Hansen's avatar
Support Bloom models  
Casper Hansen committed
4 
from .falcon import FalconAWQForCausalLM
EC2 Default User's avatar
added gptj  
EC2 Default User committed
5 
from .bloom import BloomAWQForCausalLM
Casper Hansen's avatar
Add GPT BigCode support (StarCoder)  
Casper Hansen committed
6 
from .gptj import GPTJAWQForCausalLM
Casper Hansen's avatar
Mistral support  
Casper Hansen committed
7
8 
from .gpt_bigcode import GptBigCodeAWQForCausalLM
from .mistral import MistralAWQForCausalLM