Skip to content

GitLab

Unverified Commit 56eb52ec authored by yunzhoul-nv's avatar yunzhoul-nv Committed by GitHub
Browse files

docs: removes the debug knob for kimi-k2.5 with specdec (#7576) 


Signed-off-by: default avatarYunzhou Liu <232973175+yunzhoul-nv@users.noreply.github.com>
parent 5631db75
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
recipes/kimi-k2.5/trtllm/agg/nvidia/deploy-specdec.yaml
View file @ 56eb52ec
...@@ -111,8 +111,6 @@ spec: ...@@ -111,8 +111,6 @@ spec:
value: "1" value: "1"
- name: TLLM_LOG_LEVEL - name: TLLM_LOG_LEVEL
value: INFO value: INFO
- name: TLLM_SPEC_DECODE_FORCE_NUM_ACCEPTED_TOKENS
value: "2"
volumeMounts: volumeMounts:
- name: llm-config-specdec - name: llm-config-specdec
mountPath: /opt/dynamo/configs mountPath: /opt/dynamo/configs
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment