Fix typo in tokenizer.py (#750)

conjuction -> conjunction

Fix typo in tokenizer.py (#750)
conjuction -> conjunction
805de738 · Ikko Eltociear Ashimine · GitHub · 1b151ed1 · 805de738
Unverified Commit 805de738 authored Aug 15, 2023 by Ikko Eltociear Ashimine Committed by GitHub Aug 14, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

vllm/transformers_utils/tokenizer.py vllm/transformers_utils/tokenizer.py +1 -1

No files found.
--- a/vllm/transformers_utils/tokenizer.py
+++ b/vllm/transformers_utils/tokenizer.py
@@ -72,7 +72,7 @@ def detokenize_incrementally(
    new_token_id: int,
    skip_special_tokens: bool,
 ) -> Tuple[str, str]:
-    """Detokenizes the new token in conjuction with the previous output tokens.
+    """Detokenizes the new token in conjunction with the previous output tokens.

    NOTE: This function does not update prev_output_tokens.