Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Repository
23f322297f33a50dd1fe0870665d0c4414fd78ab
Switch branch/tag
vllm_cscc
vllm
model_executor
model_loader
loader.py
Find file
Blame
History
Permalink
support bitsandbytes 8-bit and FP4 quantized models (#7445)
· 4664ceaa
chenqianfzh
authored
Aug 29, 2024
4664ceaa
loader.py
46.7 KB
Edit
Web IDE
Replace loader.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace loader.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
