Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
bitsandbytes
Commits
11df723f
Commit
11df723f
authored
Jun 06, 2025
by
Matthew Douglas
Browse files
Update README.md
parent
e9f3605f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
49 additions
and
13 deletions
+49
-13
README.md
README.md
+49
-13
No files found.
README.md
View file @
11df723f
...
@@ -25,13 +25,25 @@ bitsandbytes has the following minimum requirements for all platforms:
...
@@ -25,13 +25,25 @@ bitsandbytes has the following minimum requirements for all platforms:
#### Accelerator support:
#### Accelerator support:
<small>
Note: this table reflects the status of the current development branch. For the latest stable release, see the
[
document in the v0.46.0 tag
](
https://github.com/bitsandbytes-foundation/bitsandbytes/blob/0.46.0/README.md#accelerator-support
)
.
</small>
##### Legend:
🚧 = In Development,
〰️ = Partially Supported,
✅ = Supported,
❌ = Not Supported
<table>
<table>
<thead>
<thead>
<tr>
<tr>
<th>
Platform
</th>
<th>
Platform
</th>
<th>
Accelerator
</th>
<th>
Accelerator
</th>
<th>
Hardware Requirements
</th>
<th>
Hardware Requirements
</th>
<th>
Support Status
</th>
<th>
LLM.int8()
</th>
<th>
QLoRA 4-bit
</th>
<th>
8-bit Optimizers
</th>
</tr>
</tr>
</thead>
</thead>
<tbody>
<tbody>
...
@@ -42,13 +54,17 @@ bitsandbytes has the following minimum requirements for all platforms:
...
@@ -42,13 +54,17 @@ bitsandbytes has the following minimum requirements for all platforms:
<td
align=
"right"
>
x86-64
</td>
<td
align=
"right"
>
x86-64
</td>
<td>
◻️ CPU
</td>
<td>
◻️ CPU
</td>
<td>
AVX2
</td>
<td>
AVX2
</td>
<td>
〰️ Partial Support
</td>
<td>
〰️
</td>
<td>
〰️
</td>
<td>
❌
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
<td>
🟩 NVIDIA GPU
<br><code>
cuda
</code></td>
<td>
🟩 NVIDIA GPU
<br><code>
cuda
</code></td>
<td>
SM50+ minimum
<br>
SM75+ recommended
</td>
<td>
SM50+ minimum
<br>
SM75+ recommended
</td>
<td>
✅ Full Support
</td>
<td>
✅
</td>
<td>
✅
</td>
<td>
✅
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
...
@@ -57,7 +73,9 @@ bitsandbytes has the following minimum requirements for all platforms:
...
@@ -57,7 +73,9 @@ bitsandbytes has the following minimum requirements for all platforms:
CDNA: gfx90a, gfx942
<br>
CDNA: gfx90a, gfx942
<br>
RDNA: gfx1100, gfx1200
RDNA: gfx1100, gfx1200
</td>
</td>
<td>
🚧 In Development
</td>
<td>
🚧
</td>
<td>
🚧
</td>
<td>
🚧
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
...
@@ -67,25 +85,33 @@ bitsandbytes has the following minimum requirements for all platforms:
...
@@ -67,25 +85,33 @@ bitsandbytes has the following minimum requirements for all platforms:
Arc A-Series (Alchemist)
<br>
Arc A-Series (Alchemist)
<br>
Arc B-Series (Battlemage)
Arc B-Series (Battlemage)
</td>
</td>
<td>
🚧 In Development
</td>
<td>
🚧
</td>
<td>
🚧
</td>
<td>
🚧
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
<td>
🟪 Intel Gaudi
<br><code>
hpu
</code></td>
<td>
🟪 Intel Gaudi
<br><code>
hpu
</code></td>
<td>
Gaudi1, Gaudi2, Gaudi3
</td>
<td>
Gaudi1, Gaudi2, Gaudi3
</td>
<td>
🚧 In Development
</td>
<td>
🚧
</td>
<td>
🚧
</td>
<td>
❌
</td>
</tr>
</tr>
<tr>
<tr>
<td
align=
"right"
>
aarch64
</td>
<td
align=
"right"
>
aarch64
</td>
<td>
◻️ CPU
</td>
<td>
◻️ CPU
</td>
<td></td>
<td></td>
<td>
〰️ Partial Support
</td>
<td>
〰️
</td>
<td>
〰️
</td>
<td>
❌
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
<td>
🟩 NVIDIA GPU
<br><code>
cuda
</code></td>
<td>
🟩 NVIDIA GPU
<br><code>
cuda
</code></td>
<td>
SM75, SM80, SM90, SM100
</td>
<td>
SM75, SM80, SM90, SM100
</td>
<td>
✅ Full Support
</td>
<td>
✅
</td>
<td>
✅
</td>
<td>
✅
</td>
</tr>
</tr>
<tr>
<tr>
<td
colspan=
"4"
>
🪟
<strong>
Windows 11 / Windows Server 2019+
</strong></td>
<td
colspan=
"4"
>
🪟
<strong>
Windows 11 / Windows Server 2019+
</strong></td>
...
@@ -94,13 +120,17 @@ bitsandbytes has the following minimum requirements for all platforms:
...
@@ -94,13 +120,17 @@ bitsandbytes has the following minimum requirements for all platforms:
<td
align=
"right"
>
x86-64
</td>
<td
align=
"right"
>
x86-64
</td>
<td>
◻️ CPU
</td>
<td>
◻️ CPU
</td>
<td>
AVX2
</td>
<td>
AVX2
</td>
<td>
〰️ Partial Support
</td>
<td>
〰️
</td>
<td>
〰️
</td>
<td>
❌
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
<td>
🟩 NVIDIA GPU
<br><code>
cuda
</code></td>
<td>
🟩 NVIDIA GPU
<br><code>
cuda
</code></td>
<td>
SM50+ minimum
<br>
SM75+ recommended
</td>
<td>
SM50+ minimum
<br>
SM75+ recommended
</td>
<td>
✅ Full Support
</td>
<td>
✅
</td>
<td>
✅
</td>
<td>
✅
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
...
@@ -109,7 +139,9 @@ bitsandbytes has the following minimum requirements for all platforms:
...
@@ -109,7 +139,9 @@ bitsandbytes has the following minimum requirements for all platforms:
Arc A-Series (Alchemist)
<br>
Arc A-Series (Alchemist)
<br>
Arc B-Series (Battlemage)
Arc B-Series (Battlemage)
</td>
</td>
<td>
🚧 In Development
</td>
<td>
🚧
</td>
<td>
🚧
</td>
<td>
🚧
</td>
</tr>
</tr>
<tr>
<tr>
<td
colspan=
"4"
>
🍎
<strong>
macOS 13.1+
</strong></td>
<td
colspan=
"4"
>
🍎
<strong>
macOS 13.1+
</strong></td>
...
@@ -118,13 +150,17 @@ bitsandbytes has the following minimum requirements for all platforms:
...
@@ -118,13 +150,17 @@ bitsandbytes has the following minimum requirements for all platforms:
<td
align=
"right"
>
arm64
</td>
<td
align=
"right"
>
arm64
</td>
<td>
◻️ CPU
</td>
<td>
◻️ CPU
</td>
<td>
Apple M1+
</td>
<td>
Apple M1+
</td>
<td>
🚧 In Development
</td>
<td>
🚧
</td>
<td>
🚧
</td>
<td>
❌
</td>
</tr>
</tr>
<tr>
<tr>
<td></td>
<td></td>
<td>
⬜ Metal
<br><code>
mps
</code></td>
<td>
⬜ Metal
<br><code>
mps
</code></td>
<td>
Apple M1+
</td>
<td>
Apple M1+
</td>
<td>
🚧 In Development
</td>
<td>
🚧
</td>
<td>
🚧
</td>
<td>
❌
</td>
</tbody>
</tbody>
</table>
</table>
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment