Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
mod.rs 306 Bytes
Newer Older
Yongming Ding's avatar
refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440)  
Yongming Ding committed
1
2
3
4
5 
// SPDX-FileCopyrightText: Copyright (c) 2024-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
// SPDX-License-Identifier: Apache-2.0

//! Pluggable KV cache block managers.
Yongming Ding's avatar
feat(mocker): add SGLang engine simulation (#6977)  
Yongming Ding committed
6 
pub mod sglang_backend;
Yongming Ding's avatar
refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440)  
Yongming Ding committed
7
8 
pub mod vllm_backend;
Yongming Ding's avatar
feat(mocker): add SGLang engine simulation (#6977)  
Yongming Ding committed
9 
pub use sglang_backend::SglangKvManager;
Yongming Ding's avatar
refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440)  
Yongming Ding committed
10 
pub use vllm_backend::KvManager;