GitLab

Refactor LoRAManager and LoRAMemoryPool state management logic for dynamic LoRA loading support (#7412)

Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>

Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>

Co-authored-by: kavioyu <kavioyu@tencent.com>

Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>

Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)

Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>

Co-authored-by: michael <michael.zhang@amd.com>

Co-authored-by: yizhang2077 <1109276519@qq.com>

Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>

Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: 颉沆 <xiehang.lsy@alibaba-inc.com>

Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>