Skip to content

GitLab

Unverified Commit d8a98a2c authored by Stefan He's avatar Stefan He Committed by GitHub
Browse files

[Docs] Improve DPSK docs in dark mode (#3914)

parent 0519269d
Hide whitespace changes
Inline Side-by-side
Showing with 40 additions and 68 deletions
docs/references/deepseek.md
View file @ d8a98a2c
...@@ -8,74 +8,46 @@ Special thanks to Meituan's Search & Recommend Platform Team and Baseten's Model ...@@ -8,74 +8,46 @@ Special thanks to Meituan's Search & Recommend Platform Team and Baseten's Model
SGLang is recognized as one of the top engines for [DeepSeek model inference](https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3). To run DeepSeek V3/R1 models, the requirements are as follows: SGLang is recognized as one of the top engines for [DeepSeek model inference](https://github.com/sgl-project/sglang/tree/main/benchmark/deepseek_v3). To run DeepSeek V3/R1 models, the requirements are as follows:
<!DOCTYPE html> | Weight Type | Configuration |
<html lang="en"> |------------|-------------------|
<head> | **Full precision FP8**<br>*(recommended)* | 8 x H200 |
<meta charset="UTF-8"> | | 8 x MI300X |
<meta name="viewport" content="width=device-width, initial-scale=1.0"> | | 2 x 8 x H100/800/20 |
<title>Weight Configurations</title> | **Full precision BF16** | 2 x 8 x H200 |
<style> | | 2 x 8 x MI300X |
table { | | 4 x 8 x H100/800/20 |
width: 100%; | | 4 x 8 x A100/A800 |
border-collapse: collapse; | **Quantized weights (AWQ)** | 8 x H100/800/20 |
margin: 20px 0; | | 8 x A100/A800 |
}
th, td { <style>
border: 1px solid #ddd; .md-typeset__table {
padding: 12px; width: 100%;
text-align: left; }
}
th { .md-typeset__table table {
background-color: #f2f2f2; border-collapse: collapse;
} margin: 1em 0;
tr:nth-child(even) { border: 2px solid var(--md-typeset-table-color);
background-color: #f9f9f9; table-layout: fixed;
} }
</style>
</head> .md-typeset__table th {
<body> border: 1px solid var(--md-typeset-table-color);
<table> border-bottom: 2px solid var(--md-typeset-table-color);
<thead> background-color: var(--md-default-bg-color--lighter);
<tr> padding: 12px;
<th>Weight Type</th> }
<th>Configuration</th>
</tr> .md-typeset__table td {
</thead> border: 1px solid var(--md-typeset-table-color);
<tbody> padding: 12px;
<tr> }
<td rowspan="3"><b>Full precision FP8 (recommended)</b></td>
<td>8 x H200</td> .md-typeset__table tr:nth-child(2n) {
</tr> background-color: var(--md-default-bg-color--lightest);
<tr> }
<td>8 x MI300X</td> </style>
</tr>
<tr>
<td>2 x 8 x H100/800/20</td>
</tr>
<tr>
<td rowspan="4">Full precision BF16</td>
<td>2 x 8 x H200</td>
</tr>
<tr>
<td>2 x 8 x MI300X</td>
</tr>
<tr>
<td>4 x 8 x H100/800/20</td>
</tr>
<tr>
<td>4 x 8 x A100/A800</td>
</tr>
<tr>
<td rowspan="2">Quantized weights (AWQ)</td>
<td>8 x H100/800/20</td>
</tr>
<tr>
<td>8 x A100/A800</td>
</tr>
</tbody>
</table>
</body>
</html>
Detailed commands for reference: Detailed commands for reference:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment