• Jules Gagnon-Marchand's avatar
    Deterministic dataset order fix (#5098) · 468d8bb6
    Jules Gagnon-Marchand authored
    * Deterministic dataset order fix
    
    In order for the order of the files to be deterministic, in `tf.data.Dataset.list_files(..., shuffle)`, shuffle needs to be True, otherwise different iterator inits will yield different file orders
    
    * removed unnecessary shuffle of filenames
    
    * Removed the `_FILE_SHUFFLE_BUFFER` definition
    468d8bb6
dataset.py 11.1 KB