Skip to content

GitLab

Unverified Commit 08f6fa0b authored by Nicolas Patry's avatar Nicolas Patry
Browse files

Removing experimental to prefill chunking.

parent d96dcb17
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 3 deletions
server/text_generation_server/models/model.py
View file @ 08f6fa0b
...@@ -86,9 +86,7 @@ class Model(ABC): ...@@ -86,9 +86,7 @@ class Model(ABC):
) )
support_chunking = False support_chunking = False
log_master( log_master(logger.info, f"Using prefill chunking = {support_chunking}")
logger.info, f"Using experimental prefill chunking = {support_chunking}"
)
self.support_chunking = support_chunking self.support_chunking = support_chunking
set_support_chunking(support_chunking) set_support_chunking(support_chunking)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment