Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
67d115db
Unverified
Commit
67d115db
authored
Aug 15, 2024
by
jack
Committed by
GitHub
Aug 14, 2024
Browse files
[Bugfix][Frontend] Disable embedding API for chat models (#7504)
Co-authored-by:
jack
<
jack@alex
>
parent
d3d9cb6e
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
vllm/entrypoints/openai/serving_embedding.py
vllm/entrypoints/openai/serving_embedding.py
+4
-1
No files found.
vllm/entrypoints/openai/serving_embedding.py
View file @
67d115db
...
...
@@ -71,7 +71,7 @@ class OpenAIServingEmbedding(OpenAIServing):
lora_modules
=
None
,
prompt_adapters
=
None
,
request_logger
=
request_logger
)
self
.
_check_embedding_mode
(
model_config
.
embedding_mode
)
self
.
_enabled
=
self
.
_check_embedding_mode
(
model_config
.
embedding_mode
)
async
def
create_embedding
(
self
,
...
...
@@ -83,6 +83,8 @@ class OpenAIServingEmbedding(OpenAIServing):
See https://platform.openai.com/docs/api-reference/embeddings/create
for the API specification. This API mimics the OpenAI Embedding API.
"""
if
not
self
.
_enabled
:
return
self
.
create_error_response
(
"Embedding API disabled"
)
error_check_ret
=
await
self
.
_check_model
(
request
)
if
error_check_ret
is
not
None
:
return
error_check_ret
...
...
@@ -179,3 +181,4 @@ class OpenAIServingEmbedding(OpenAIServing):
"embedding_mode is False. Embedding API will not work."
)
else
:
logger
.
info
(
"Activating the server engine with embedding enabled."
)
return
embedding_mode
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment