Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
mod.rs 392 Bytes
Newer Older
Simo Lin's avatar
[router] grpc router bootstraps (#9759)  
Simo Lin committed
1
2 
//! gRPC router implementations
Simo Lin's avatar
[router] add grpc router pd mode for chat and generate (#11140)  
Simo Lin committed
3
4
5 
use crate::grpc_client::proto;
use crate::protocols::spec::StringOrArray;
Simo Lin's avatar
[router] grpc router bootstraps (#9759)  
Simo Lin committed
6
7 
pub mod pd_router;
pub mod router;
Simo Lin's avatar
[router] add grpc router pd mode for chat and generate (#11140)  
Simo Lin committed
8
9
10
11
12
13
14
15
16 
pub mod utils;

/// Processed chat messages ready for gRPC generation
#[derive(Debug)]
pub struct ProcessedMessages {
    pub text: String,
    pub multimodal_inputs: Option<proto::MultimodalInputs>,
    pub stop_sequences: Option<StringOrArray>,
}