Skip to content

GitLab

Unverified Commit d8a98a2c authored by Stefan He's avatar Stefan He Committed by GitHub
Browse files

[Docs] Improve DPSK docs in dark mode (#3914)

parent 0519269d
Show whitespace changes
Inline Side-by-side
Showing with 40 additions and 68 deletions
docs/references/deepseek.md
View file @ d8a98a2c
...@@ -8,74 +8,46 @@ Special thanks to Meituan's Search & Recommend Platform Team and Baseten's Model ...@@ -8,74 +8,46 @@ Special thanks to Meituan's Search & Recommend Platform Team and Baseten's Model
SGLang is recognized as one of the top engines for [DeepSeek model inference](https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3). To run DeepSeek V3/R1 models, the requirements are as follows: SGLang is recognized as one of the top engines for [DeepSeek model inference](https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3). To run DeepSeek V3/R1 models, the requirements are as follows:
<!DOCTYPE html> | Weight Type | Configuration |
<html lang="en"> |------------|-------------------|
<head> | **Full precision FP8**<br>*(recommended)* | 8 x H200 |
<meta charset="UTF-8"> | | 8 x MI300X |
<meta name="viewport" content="width=device-width, initial-scale=1.0"> | | 2 x 8 x H100/800/20 |
<title>Weight Configurations</title> | **Full precision BF16** | 2 x 8 x H200 |
<style> | | 2 x 8 x MI300X |
table { | | 4 x 8 x H100/800/20 |
| | 4 x 8 x A100/A800 |
| **Quantized weights (AWQ)** | 8 x H100/800/20 |
| | 8 x A100/A800 |
<style>
.md-typeset__table {
width: 100%; width: 100%;
}
.md-typeset__table table {
border-collapse: collapse; border-collapse: collapse;
margin: 20px 0; margin: 1em 0;
} border: 2px solid var(--md-typeset-table-color);
th, td { table-layout: fixed;
border: 1px solid #ddd; }
.md-typeset__table th {
border: 1px solid var(--md-typeset-table-color);
border-bottom: 2px solid var(--md-typeset-table-color);
background-color: var(--md-default-bg-color--lighter);
padding: 12px;
}
.md-typeset__table td {
border: 1px solid var(--md-typeset-table-color);
padding: 12px; padding: 12px;
text-align: left; }
}
th { .md-typeset__table tr:nth-child(2n) {
background-color: #f2f2f2; background-color: var(--md-default-bg-color--lightest);
} }
tr:nth-child(even) { </style>
background-color: #f9f9f9;
}
</style>
</head>
<body>
<table>
<thead>
<tr>
<th>Weight Type</th>
<th>Configuration</th>
</tr>
</thead>
<tbody>
<tr>
<td rowspan="3"><b>Full precision FP8 (recommended)</b></td>
<td>8 x H200</td>
</tr>
<tr>
<td>8 x MI300X</td>
</tr>
<tr>
<td>2 x 8 x H100/800/20</td>
</tr>
<tr>
<td rowspan="4">Full precision BF16</td>
<td>2 x 8 x H200</td>
</tr>
<tr>
<td>2 x 8 x MI300X</td>
</tr>
<tr>
<td>4 x 8 x H100/800/20</td>
</tr>
<tr>
<td>4 x 8 x A100/A800</td>
</tr>
<tr>
<td rowspan="2">Quantized weights (AWQ)</td>
<td>8 x H100/800/20</td>
</tr>
<tr>
<td>8 x A100/A800</td>
</tr>
</tbody>
</table>
</body>
</html>
Detailed commands for reference: Detailed commands for reference:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment