Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
dac63127
Commit
dac63127
authored
Mar 14, 2025
by
Ryan McCormick
Committed by
GitHub
Mar 14, 2025
Browse files
fix: Fix cargo doc warnings for lib/llm (#151)
parent
7df6bb18
Changes
5
Hide whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
5 additions
and
5 deletions
+5
-5
lib/llm/src/http/service.rs
lib/llm/src/http/service.rs
+1
-1
lib/llm/src/http/service/discovery.rs
lib/llm/src/http/service/discovery.rs
+1
-1
lib/llm/src/kv_router/protocols.rs
lib/llm/src/kv_router/protocols.rs
+1
-1
lib/llm/src/preprocessor.rs
lib/llm/src/preprocessor.rs
+1
-1
lib/llm/src/protocols/openai/chat_completions/delta.rs
lib/llm/src/protocols/openai/chat_completions/delta.rs
+1
-1
No files found.
lib/llm/src/http/service.rs
View file @
dac63127
...
@@ -28,7 +28,7 @@
...
@@ -28,7 +28,7 @@
//! TODO(): Add support for model-specific metadata and status. Status will allow us to return a 503 when the model is supposed
//! TODO(): Add support for model-specific metadata and status. Status will allow us to return a 503 when the model is supposed
//! to be ready, but there is a problem with the model.
//! to be ready, but there is a problem with the model.
//!
//!
//! The [`service::HttpService`] can be further extended to host any [`axum::Router`] using the [`service::HttpServiceBuilder`].
//! The [`service
_v2
::HttpService`] can be further extended to host any [`axum::Router`] using the [`service
_v2
::HttpService
Config
Builder`].
mod
openai
;
mod
openai
;
...
...
lib/llm/src/http/service/discovery.rs
View file @
dac63127
...
@@ -38,7 +38,7 @@ use tracing;
...
@@ -38,7 +38,7 @@ use tracing;
pub
struct
ModelEntry
{
pub
struct
ModelEntry
{
/// Public name of the model
/// Public name of the model
/// This will be used to identify the model in the HTTP service and the value used in an
/// This will be used to identify the model in the HTTP service and the value used in an
/// an [OAI ChatRequest][crate::protocols::openai::chat_completions::ChatCompletionRequest].
/// an [OAI ChatRequest][crate::protocols::openai::chat_completions::
NvCreate
ChatCompletionRequest].
pub
name
:
String
,
pub
name
:
String
,
/// Component of the endpoint.
/// Component of the endpoint.
...
...
lib/llm/src/kv_router/protocols.rs
View file @
dac63127
...
@@ -29,7 +29,7 @@ pub struct ForwardPassMetrics {
...
@@ -29,7 +29,7 @@ pub struct ForwardPassMetrics {
pub
gpu_prefix_cache_hit_rate
:
f32
,
pub
gpu_prefix_cache_hit_rate
:
f32
,
}
}
/// A [`BlockHash`] is a hash computed from the tokens_ids, extra_token_ids and the optional
/// A [`
Local
BlockHash`] is a hash computed from the tokens_ids, extra_token_ids and the optional
/// lora_id of a block.
/// lora_id of a block.
#[derive(Clone,
Copy,
Debug,
PartialEq,
Eq,
Hash,
Ord,
PartialOrd)]
#[derive(Clone,
Copy,
Debug,
PartialEq,
Eq,
Hash,
Ord,
PartialOrd)]
pub
struct
LocalBlockHash
(
pub
u64
);
pub
struct
LocalBlockHash
(
pub
u64
);
...
...
lib/llm/src/preprocessor.rs
View file @
dac63127
...
@@ -88,7 +88,7 @@ impl OpenAIPreprocessor {
...
@@ -88,7 +88,7 @@ impl OpenAIPreprocessor {
}))
}))
}
}
/// Translate a [`ChatCompletionRequest`] request to a common completion request.
/// Translate a [`
NvCreate
ChatCompletionRequest`] request to a common completion request.
/// Returns both the common completion request and a hashmap of annotations.
/// Returns both the common completion request and a hashmap of annotations.
///
///
/// Annotations evaluated by this method include:
/// Annotations evaluated by this method include:
...
...
lib/llm/src/protocols/openai/chat_completions/delta.rs
View file @
dac63127
...
@@ -167,7 +167,7 @@ impl DeltaGenerator {
...
@@ -167,7 +167,7 @@ impl DeltaGenerator {
}
}
}
}
/// Implements the [`DeltaGeneratorExt`] trait for [`DeltaGenerator`], allowing
/// Implements the [`
crate::protocols::openai::
DeltaGeneratorExt`] trait for [`DeltaGenerator`], allowing
/// it to transform backend responses into OpenAI-style streaming responses.
/// it to transform backend responses into OpenAI-style streaming responses.
impl
crate
::
protocols
::
openai
::
DeltaGeneratorExt
<
NvCreateChatCompletionStreamResponse
>
impl
crate
::
protocols
::
openai
::
DeltaGeneratorExt
<
NvCreateChatCompletionStreamResponse
>
for
DeltaGenerator
for
DeltaGenerator
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment