GitLab

Mistral fused modules

Fix Falcon n_kv_heads parameter

Fix unexpected keyword

Faster build, fix "no space left".

Offloading to cpu and disk

Add low_cpu_mem_usage=True in example

Mistral support

Fix KV cache shapes error

Use typing classes over base types

Add GPT BigCode support (StarCoder)

Improve model loading