Skip to content

GitLab

"lib/vscode:/vscode.git/clone" did not exist on "31f5ed3ce7db3eef7b2991963644f5fdb17ab063"
Unverified Commit b7224eb5 authored by jthomson04's avatar jthomson04 Committed by GitHub
Browse files

fix: Fix Qwen3-8b-fp8 recipe (#7010) 


Signed-off-by: default avatarjthomson04 <jwillthomson19@gmail.com>
parent 734c0b8b
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 4 deletions
recipes/qwen3-32b-fp8/trtllm/disagg/deploy.yaml
View file @ b7224eb5
...@@ -12,8 +12,8 @@ data: ...@@ -12,8 +12,8 @@ data:
enable_attention_dp: false enable_attention_dp: false
enable_chunked_prefill: false enable_chunked_prefill: false
max_batch_size: 128 max_batch_size: 128
max_num_tokens: 7800 max_num_tokens: 7808
max_seq_len: 7800 max_seq_len: 7808
kv_cache_config: kv_cache_config:
enable_block_reuse: false enable_block_reuse: false
free_gpu_memory_fraction: 0.7 free_gpu_memory_fraction: 0.7
...@@ -166,8 +166,8 @@ data: ...@@ -166,8 +166,8 @@ data:
enable_attention_dp: false enable_attention_dp: false
enable_chunked_prefill: false enable_chunked_prefill: false
max_batch_size: 1 max_batch_size: 1
max_num_tokens: 7800 max_num_tokens: 7808
max_seq_len: 7800 max_seq_len: 7808
kv_cache_config: kv_cache_config:
enable_block_reuse: false enable_block_reuse: false
free_gpu_memory_fraction: 0.7 free_gpu_memory_fraction: 0.7
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment