Skip to content

GitLab

"...text-generation-inference.git" did not exist on "b32e9ce9d5e5b73082e31bf5d75c458dba29d30c"
Unverified Commit d2571dd5 authored by Hui Liu's avatar Hui Liu Committed by GitHub
Browse files

Enable Cohere2 Models (#3018)

parent b730aa6b
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 1 deletion
python/sglang/srt/models/commandr.py
View file @ d2571dd5
...@@ -386,4 +386,8 @@ class CohereForCausalLM(nn.Module): ...@@ -386,4 +386,8 @@ class CohereForCausalLM(nn.Module):
loaded_params.add(name) loaded_params.add(name)
EntryClass = CohereForCausalLM class Cohere2ForCausalLM(CohereForCausalLM):
pass
EntryClass = [CohereForCausalLM, Cohere2ForCausalLM]
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment