Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
f5516039
Unverified
Commit
f5516039
authored
Dec 01, 2025
by
Liu Jinyi
Committed by
GitHub
Dec 01, 2025
Browse files
[Doc] fix heading levels (#29783)
Signed-off-by:
KKKZOZ
<
kkkzoz@qq.com
>
parent
36db0a35
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
benchmarks/auto_tune/README.md
benchmarks/auto_tune/README.md
+2
-2
No files found.
benchmarks/auto_tune/README.md
View file @
f5516039
...
@@ -83,7 +83,7 @@ MIN_CACHE_HIT_PCT=0
...
@@ -83,7 +83,7 @@ MIN_CACHE_HIT_PCT=0
MAX_LATENCY_ALLOWED_MS
=
100000000000
# A very large number
MAX_LATENCY_ALLOWED_MS
=
100000000000
# A very large number
```
```
###
#
2. Maximize Throughput with a Latency Requirement
### 2. Maximize Throughput with a Latency Requirement
-
**Goal**
: Find the best server parameters when P99 end-to-end latency must be below 500ms.
-
**Goal**
: Find the best server parameters when P99 end-to-end latency must be below 500ms.
-
**Configuration**
:
-
**Configuration**
:
...
@@ -96,7 +96,7 @@ MIN_CACHE_HIT_PCT=0
...
@@ -96,7 +96,7 @@ MIN_CACHE_HIT_PCT=0
MAX_LATENCY_ALLOWED_MS
=
500
MAX_LATENCY_ALLOWED_MS
=
500
```
```
###
#
3. Maximize Throughput with Prefix Caching and Latency Requirements
### 3. Maximize Throughput with Prefix Caching and Latency Requirements
-
**Goal**
: Find the best server parameters assuming a 60% prefix cache hit rate and a latency requirement of 500ms.
-
**Goal**
: Find the best server parameters assuming a 60% prefix cache hit rate and a latency requirement of 500ms.
-
**Configuration**
:
-
**Configuration**
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment