Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
ff8c4005
Unverified
Commit
ff8c4005
authored
May 09, 2025
by
Yan Ma
Committed by
GitHub
May 09, 2025
Browse files
[Doc] remove visible token in doc (#17884)
Signed-off-by:
yan
<
yanma1@habana.ai
>
parent
89a0315f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
docs/source/design/v1/prefix_caching.md
docs/source/design/v1/prefix_caching.md
+1
-1
No files found.
docs/source/design/v1/prefix_caching.md
View file @
ff8c4005
...
@@ -86,7 +86,7 @@ To improve privacy in shared environments, vLLM supports isolating prefix cache
...
@@ -86,7 +86,7 @@ To improve privacy in shared environments, vLLM supports isolating prefix cache
{
"role"
:
"user"
,
"content"
:
"Here is a document with details about the world series: ..."
},
{
"role"
:
"user"
,
"content"
:
"Here is a document with details about the world series: ..."
},
{
"role"
:
"user"
,
"content"
:
"Who won the world series in 2020?"
}
{
"role"
:
"user"
,
"content"
:
"Who won the world series in 2020?"
}
],
],
"cache_salt"
:
"
Z3V2bmV3aGxza3ZubGFoZ3Zud3V3ZWZ2bmd0b3V2bnZmc2xpZ3RoZ2x2aQ==
"
"cache_salt"
:
"
your-cache-salt
"
}
}
```
```
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment