• Nicolas Patry's avatar
    [DX fix] Fixing QA pipeline streaming a dataset. (#18516) · a4562552
    Nicolas Patry authored
    * [DX fix] Fixing QA pipeline streaming a dataset.
    
    QuestionAnsweringArgumentHandler would iterate over the whole dataset
    effectively killing all properties of the pipeline.
    This restores nice properties when using `Dataset` or `Generator` since
    those are meant to be consumed lazily.
    
    * Handling TF better.
    a4562552
test_pipelines_question_answering.py 24.7 KB