Skip to content

GitLab

Unverified Commit 8e836d98 authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

[Doc] Fix code formatting in spec_decode.rst (#9348)

parent 44eaa5a5
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
docs/source/models/spec_decode.rst
View file @ 8e836d98
...@@ -47,7 +47,7 @@ To perform the same with an online mode launch the server: ...@@ -47,7 +47,7 @@ To perform the same with an online mode launch the server:
--seed 42 -tp 1 --speculative_model facebook/opt-125m --use-v2-block-manager \ --seed 42 -tp 1 --speculative_model facebook/opt-125m --use-v2-block-manager \
--num_speculative_tokens 5 --gpu_memory_utilization 0.8 --num_speculative_tokens 5 --gpu_memory_utilization 0.8
Then use a client: Then use a client:
.. code-block:: python .. code-block:: python
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment