Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • Nicolas Patry's avatar
    Fixing support `batch_size` and `num_return_Sequences` in `text-generation` pipeline (#15318) · 06107541
    Nicolas Patry authored 
    * Fixing support `batch_size` and `num_return_Sequences` in
`text-generation` pipeline

And `text2text-generation` too.

The bug was caused by the batch_size containing both the incoming batch
**and** the generated `num_sequences`.

The fix simply consists into splitting both of these again into
different dimensions.

* TF support.

* Odd backward compatibility script in the way.
    06107541
test_pipelines_text_generation.py 7.07 KB