Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
da6f4092
Unverified
Commit
da6f4092
authored
Dec 16, 2024
by
AlexHe99
Committed by
GitHub
Dec 15, 2024
Browse files
Update deploying_with_k8s.rst (#10922)
parent
25ebed2f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
docs/source/serving/deploying_with_k8s.rst
docs/source/serving/deploying_with_k8s.rst
+2
-2
No files found.
docs/source/serving/deploying_with_k8s.rst
View file @
da6f4092
...
...
@@ -162,7 +162,7 @@ To test the deployment, run the following ``curl`` command:
curl http://mistral-7b.default.svc.cluster.local/v1/completions \
-H "Content-Type: application/json" \
-d '{
"model": "
facebook/opt-125m
",
"model": "
mistralai/Mistral-7B-Instruct-v0.3
",
"prompt": "San Francisco is a",
"max_tokens": 7,
"temperature": 0
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment