"vscode:/vscode.git/clone" did not exist on "9c7b744795623ad045473680bf8cd79c2058b780"
Llama tokenizer: remove space in template comment (#26788)
* Remove space in template comment I think the space between the eos and bos tokens is not present in the actual template output. I'm using this documentation as a reference for everyone asking about prompting, so would like to clarify whether there's a space or not :) * Update fast tokenizer too * Apply to Code Llama * Link to original code snippet.
Showing
Please register or sign in to comment