• Nicolas Patry's avatar
    [Large PR] Entire rework of pipelines. (#13308) · c63fcabf
    Nicolas Patry authored
    
    
    * Enabling dataset iteration on pipelines.
    
    Enabling dataset iteration on pipelines.
    
    Unifying parameters under `set_parameters` function.
    
    Small fix.
    
    Last fixes after rebase
    
    Remove print.
    
    Fixing text2text `generate_kwargs`
    
    No more `self.max_length`.
    
    Fixing tf only conversational.
    
    Consistency in start/stop index over TF/PT.
    
    Speeding up drastically on TF (nasty bug where max_length would increase
    a ton.)
    
    Adding test for support for non fast tokenizers.
    
    Fixign GPU usage on zero-shot.
    
    Fix working on Tf.
    
    Update src/transformers/pipelines/base.py
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    Update src/transformers/pipelines/base.py
    Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
    
    Small cleanup.
    
    Remove all asserts + simple format.
    
    * Fixing audio-classification for large PR.
    
    * Overly explicity null checking.
    
    * Encapsulating GPU/CPU pytorch manipulation directly within `base.py`.
    
    * Removed internal state for parameters of the  pipeline.
    
    Instead of overriding implicitly internal state, we moved
    to real named arguments on every `preprocess`, `_forward`,
    `postprocess` function.
    
    Instead `_sanitize_parameters` will be used to split all kwargs
    of both __init__ and __call__ into the 3 kinds of named parameters.
    
    * Move import warnings.
    
    * Small fixes.
    
    * Quality.
    
    * Another small fix, using the CI to debug faster.
    
    * Last fixes.
    
    * Last fix.
    
    * Small cleanup of tensor moving.
    
    * is not None.
    
    * Adding a bunch of docs + a iteration test.
    
    * Fixing doc style.
    
    * KeyDataset = None guard.
    
    * RRemoving the Cuda test for pipelines (was testing).
    
    * Even more simple iteration test.
    
    * Correct import .
    
    * Long day.
    
    * Fixes in docs.
    
    * [WIP] migrating object detection.
    
    * Fixed the target_size bug.
    
    * Fixup.
    
    * Bad variable name.
    
    * Fixing `ensure_on_device` respects original ModelOutput.
    c63fcabf
test_pipelines_object_detection.py 10.6 KB