Unverified Commit 40d0e741 authored by whyiug's avatar whyiug Committed by GitHub
Browse files

[Doc] Update FAQ links in spec_decode.rst (#9662)


Signed-off-by: default avatarwhyiug <whyiug@hotmail.com>
parent 6bb52b0f
...@@ -182,7 +182,7 @@ speculative decoding, breaking down the guarantees into three key areas: ...@@ -182,7 +182,7 @@ speculative decoding, breaking down the guarantees into three key areas:
3. **vLLM Logprob Stability** 3. **vLLM Logprob Stability**
- vLLM does not currently guarantee stable token log probabilities (logprobs). This can result in different outputs for the - vLLM does not currently guarantee stable token log probabilities (logprobs). This can result in different outputs for the
same request across runs. For more details, see the FAQ section same request across runs. For more details, see the FAQ section
titled *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq.rst>`_. titled *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq>`_.
**Conclusion** **Conclusion**
...@@ -197,7 +197,7 @@ can occur due to following factors: ...@@ -197,7 +197,7 @@ can occur due to following factors:
**Mitigation Strategies** **Mitigation Strategies**
For mitigation strategies, please refer to the FAQ entry *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq.rst>`_. For mitigation strategies, please refer to the FAQ entry *Can the output of a prompt vary across runs in vLLM?* in the `FAQs <../serving/faq>`_.
Resources for vLLM contributors Resources for vLLM contributors
------------------------------- -------------------------------
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment