Skip to content

GitLab

Switch branch/tag
  1. 20 Jan, 2023 12 commits
  3. 19 Jan, 2023 19 commits
    • Sylvain Gugger's avatar
      Add disclaimer for necessary fake models (#21178) · 862888a3
      Sylvain Gugger authored 
      * Add disclaimer for necessary fake models

* Address review comments

* Use for GPT-NeoX as well
      862888a3
    • Cl茅mentine Fourrier's avatar
      Graphormer model for Graph Classification (#20968) · 87208a05
      Cl茅mentine Fourrier authored 
      

* [FT] First commit for graphormer architecture.

The model has no tokenizer, as it uses a collator and preprocessing function for its input management.
Architecture to be tested against original one.
The arch might need to be changed to fit the checkpoint, but a revert to the original arch will make the code less nice to read.
TODO: doc

* [FIX] removed test model

* [FIX] import error

* [FIX] black and flake

* [DOC] added paper refs

* [FIX] [DOC]

* [FIX] black

* [DOC] Updated READMEs

* [FIX] Order of imports + rm Tokenizer calls

* [FIX] Moved assert in class to prevent doc build failure

* [FIX] make fix-copies

* [Doc] update from code review
Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>

* [FIX] Removed Graphormer from Sequence classification model list

* [DOC] Added HF copyright to Cython file

* [DOC] Fixed comments

* [FIX] typos in class doc + removed config classes.

Todo: update doc from paper definitions

* [FIX] Removed dependency to fairseq, and replaced all asserts with Exception management

* [FIX] Homogeneized initialization of weights to pretrained constructor

* [FIX] [CP] Updated multi_hop parameter to get same results as in original implementation

* [DOC] Relevant parameter description in the configuration file

* [DOC] Updated doc and comments in main graphormer file

* [FIX] make style and quality checks

* [DOC] Fix doc format

* [FIX] [WIP] Updated part of the tests, though still a wip

* [FIX] [WIP]

* [FIX] repo consistency

* [FIX] Changed input names for more understandability

* [FIX] [BUG] updated num_classes params for propagation in the model

* simplified collator

* [FIX] Updated tests to follow new naming pattern

* [TESTS] Updated test suite along with model

* |FIX] rm tokenizer import

* [DOC] add link to graphormerdoc

* Changed section in doc from text model to graph model

* Apply suggestions from code review

Spacing, inits
Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>

* [DOC] Explain algos_graphormer functions

* Cython soft import protection

* Rm call to Callable in configuration graphormer

* [FIX] replaced asserts with Exceptions

* Add org to graphormer checkpoints

* Prefixed classes with Graphormer

* Management of init functions

* format

* fixes

* fix length file

* update indent

* relaunching ci

* Errors for missing cython imports

* fix style

* fix style doc
Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
      87208a05
    • ydshieh's avatar
      revert Copyright 2023 · 758bd39e
      ydshieh authored
      758bd39e
    • Kambe Hiroyuki's avatar
      Add Japanese translation index.mdx (#21186) · 705e332b
      Kambe Hiroyuki authored 
      * Add Japanese translation index.mdx

* Fix the year of the license

* Change the models list to Japanese
      705e332b
    • Joao Gante's avatar
      Flax dtype-dependent numerical masking (#21197) · cbaaa2f6
      Joao Gante authored
      cbaaa2f6
    • Younes Belkada's avatar
      [`CVT`] Fix module initialization issue (#21193) · 0b86e330
      Younes Belkada authored 
      fix cvt init
      0b86e330
    • Karim Foda's avatar
      Add hallucination filter (#18675) · b9403e95
      Karim Foda authored 
      

* Add hallucination penalty

* Make quality changes

* Inverse penalty

* Fix imports & quality

* Fix name spelling issue

* set encoder_repetition_penalty and fix quality

* Fix failing test

* Add to config_common_kwargs

* Fix modelling_rag error

* Update src/transformers/generation_logits_process.py
Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>

* Remove breakpoint

* Make style fixes

* Update encoder_repetition_penalty default value

* Merge latest main changes

* Make fixup changes

* Add EncoderRepetitionPenaltyLogitsProcessor to generation/__init__.py

* Fix repo-inconsistency

* Remove venv

* Remove tensorflow-macos & add tests

* Add documentation

* Fix quality issues

* move encoder_repetition_penalty to config

* Update src/transformers/configuration_utils.py
Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/configuration_utils.py
Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>

* Remove encoder_repetition_penalty from tests

* Fix type error

* Fix format error
Co-authored-by: default avatarJoao Gante <joaofranciscocardosogante@gmail.com>
      b9403e95
    • Arthur's avatar
      [Whisper] Fix timestamp processor (#21187) · e9b4800d
      Arthur authored 
      

* add draft logit processor

* add template functions

* update timesapmt processor parameters

* draft script

* simplify code

* cleanup

* fixup and clean

* update pipeline

* style

* clean up previous idea

* add tokenization utils

* update tokenizer and asr output

* fit whisper type

* style and update test

* clean test

* style test

* update tests

* update error test

* udpate code (not based on review yet)

* update tokenization

* update asr pipeline

* update code

* cleanup and update test

* fmt

* remove text verificatino

* cleanup

* cleanup

* add model test

* update tests

* update code add docstring

* update code and add docstring

* fix pipeline tests

* add draft logit processor

add template functions

update timesapmt processor parameters

draft script

simplify code

cleanup

fixup and clean

update pipeline

style

clean up previous idea

add tokenization utils

update tokenizer and asr output

fit whisper type

style and update test

clean test

style test

update tests

update error test

udpate code (not based on review yet)

update tokenization

update asr pipeline

update code

cleanup and update test

fmt

remove text verificatino

cleanup

cleanup

add model test

update tests

update code add docstring

update code and add docstring

fix pipeline tests

* Small update.

* Fixup.

* Tmp.

* More support.

* Making `forced_decoder_ids` non mandatory for users to set.

* update and fix first bug

* properly process sequence right after merge if last

* tofo

* allow list inputs + compute begin index better

* start adding tests

* add the 3 edge cases

* style

* format sequences

* fixup

* update

* update

* style

* test passes, edge cases should be good

* update last value

* remove Trie

* update tests and expec ted values

* handle bigger chunk_length

* clean tests a bit

* refactor chunk iter and clean pipeline

* update tests

* style

* refactor chunk iter and clean pipeline

* upade

* resolve comments

* Apply suggestions from code review
Co-authored-by: default avatarNicolas Patry <patry.nicolas@protonmail.com>

* take stride right into account

* update test expected values

* Update code based on review
Co-authored-by: default avatarsgugger <sylvain.gugger@gmail.com>

* major refactor

* add correct strides for tests

* Update src/transformers/pipelines/automatic_speech_recognition.py

* fix whisper timestamp test
Co-authored-by: default avatarNicolas Patry <patry.nicolas@protonmail.com>
Co-authored-by: default avatarsgugger <sylvain.gugger@gmail.com>
      e9b4800d
    • Matthijs Hollemans's avatar
      hertz is already per second (#21188) · 9b42c68f
      Matthijs Hollemans authored
      9b42c68f
    • amyeroberts's avatar
      Update examples with image processors (#21155) · 4bc18e7a
      amyeroberts authored 
      * Update examples to use image processors

* Small fixes

* Resolve conflicts
      4bc18e7a
    • amyeroberts's avatar
      Rename GLPN image processor tests (#21194) · fc8a9350
      amyeroberts authored
      fc8a9350
    • Maria Khalusova's avatar
      Updates to computer vision section of the Preprocess doc (#21181) · 0359e2e1
      Maria Khalusova authored 
      

* Extended the CV preprocessing section with more details and refactored the example

* added padding to the CV section, though it is a special case

* Added a tip about post processing methods

* make style

* link update

* Apply suggestions from review
Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>

* review feedback
Co-authored-by: default avatarSteven Liu <59462357+stevhliu@users.noreply.github.com>
      0359e2e1
    • Yih-Dar's avatar
      Fix device issue in `UperNetModelIntegrationTest` (#21192) · 5761ceb3
      Yih-Dar authored 
      

fix device
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      5761ceb3
    • Sylvain Gugger's avatar
      Trigger CI · 35920c97
      Sylvain Gugger authored
      35920c97
    • Matthijs Hollemans's avatar
      workaround documentation rendering bug (#21189) · 9b468a7c
      Matthijs Hollemans authored
      9b468a7c
    • Yih-Dar's avatar
      Update year 2020 to 2023 in one file (#21190) · 464c86ac
      Yih-Dar authored 
      

* update year
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      464c86ac
    • Yih-Dar's avatar
      Fix `Mask2FormerForUniversalSegmentation` (#21175) · 1d33f55c
      Yih-Dar authored 
      

fix
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      1d33f55c
    • Jitesh Jain's avatar
      Add OneFormer Model (#20577) · 5b949623
      Jitesh Jain authored 
      * Add Oneformer Model

* Add OneFormer Tests

* Add UNIVERSAL_SEGMENTATION_MAPPING

* Fix config

* 馃悰 Fix error encountered while writing tests

* 馃敤 Fix instance segmentation post processing

* Format Files and Add Documentation

* Add Documentation mdx file

* Run make fixup

* Run make fix-copies

* Remove unnecessary code

* Format modeling_oneformer.py

* Add OneFormer to ImageSegmentationPipeline

* Format files

* Add Demo link to Readme

* Fix fomatting errors

* Fix test failures

* Update Table in index.mdx

* Fix version

* Fix style

* Remove OneFormer from TF

* Fix Imports

* Fix dummy objects

* Fix tests

* Add newline

* Remove OneFormerFeatureExtractor

* Remove CUDA Kernels

* Use AutoBackbone for Swin

* Fix description

* Use Image Processor

* Fix copies

* Fix formatting

* Fix import order

* Fix flake8 errors

* Fix doc errors

* Add Hindi Readme entry

* Update supported backbones

* Update supported backbones

* Undo Changes

* Fix type of config

* Fix isort

* Fix auto.mdx

* Fix swin config

* Replace DinatBackbone with AutoBackbone

* Use SwinBackbone

* Use SwinBackbone

* Fix conversion script

* Fix arguments

* Add argument description

* Fix style

* Add OneFormerProcessor

* Fix OneFormerProcessor Tests

* Fix mapping

* Fix imports

* Fix inits

* Fix style

* Fix comment

* Fix docstring

* Move OneFormer to MultiModal

* Fix Copies

* Remove size divisor

* Fix check_repo.py

* Fix copies

* Add Processor for Testing Pipeline

* Fix padding for tokens

* Fix variables

* Fix formatting with correct black version

* Add Image Processor Test

* Apply suggestions

* Revert common modeling

* Add check for task

* Fix conversion script

* Fix initialization order

* Fix tests

* Undo Pipeline Changes

* Fix layers in MLP

* Fix copies

* Update image paths

* Fix copies

* Apply suggestions
      5b949623
    • Stas Bekman's avatar
      [issues template] update deepspeed owners (#21027) · 6d676643
      Stas Bekman authored 
      * [issues template] update deepspeed owners

add the right contact for deepspeed@accelerate

* pr-template
      6d676643
  5. 18 Jan, 2023 9 commits