Skip to content

GitLab

Unverified Commit f790e921 authored by Yan Ru Pei's avatar Yan Ru Pei Committed by GitHub
Browse files

fix: prefill discovery (#4911) 


Signed-off-by: default avatarPeaBrane <yanrpei@gmail.com>
parent 1efc7d63
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
lib/llm/src/discovery/model_manager.rs
View file @ f790e921
...@@ -141,6 +141,7 @@ impl ModelManager { ...@@ -141,6 +141,7 @@ impl ModelManager {
pub fn has_model_any(&self, model: &str) -> bool { pub fn has_model_any(&self, model: &str) -> bool {
self.chat_completion_engines.read().contains(model) self.chat_completion_engines.read().contains(model)
|| self.completion_engines.read().contains(model) || self.completion_engines.read().contains(model)
|| self.prefill_engines.read().contains(model)
} }
pub fn model_display_names(&self) -> HashSet<String> { pub fn model_display_names(&self) -> HashSet<String> {
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment