-
zhongdaor-nv authored
feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953) Signed-off-by:zhongdaor <zhongdaor@nvidia.com>
93ada899
feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>