"proto/vscode:/vscode.git/clone" did not exist on "704a58c807a84e685542b5d9d7117317bcb8b39c"
  1. 01 Jun, 2023 2 commits
  2. 31 May, 2023 2 commits
    • Denisa Roberts's avatar
      Add TensorFlow implementation of EfficientFormer (#22620) · 88f50a1e
      Denisa Roberts authored
      * Add tf code for efficientformer
      
      * Fix return dict bug - return last hidden state after last stage
      
      * Fix corresponding return dict bug
      
      * Override test tol
      
      * Change default values of training to False
      
      * Set training to default False X3
      
      * Rm axis from ln
      
      * Set init in dense projection
      
      * Rm debug stuff
      
      * Make style; all tests pass.
      
      * Modify year to 2023
      
      * Fix attention biases codes
      
      * Update the shape list logic
      
      * Add a batch norm eps config
      
      * Remove extract comments in test files
      
      * Add conditional attn and hidden states return for serving output
      
      * Change channel dim checking logic
      
      * Add exception for withteacher model in training mode
      
      * Revert layer count for now
      
      * Add layer count for conditional layer naming
      
      * Transpose for conv happens only in main layer
      
      * Make tests smaller
      
      * Make style
      
      * Update doc
      
      * Rm from_pt
      
      * Change to actual expect image class label
      
      * Remove stray print in tests
      
      * Update image processor test
      
      * Remove the old serving output logic
      
      * Make style
      
      * Make style
      
      * Complete test
      88f50a1e
    • Sohyun Sim's avatar
      馃寪 [i18n-KO] Translated `pad_truncation.mdx` to Korean (#23823) · 015829e6
      Sohyun Sim authored
      
      
      * docs: ko: pad_truncation.mdx
      
      * feat: manual draft
      
      * fix: resolve suggestions
      Co-authored-by: default avatarHyeonseo Yun <0525yhs@gmail.com>
      
      ---------
      Co-authored-by: default avatarHyeonseo Yun <0525yhs@gmail.com>
      015829e6
  3. 30 May, 2023 5 commits
  4. 26 May, 2023 2 commits
  5. 24 May, 2023 4 commits
  6. 23 May, 2023 1 commit
  7. 22 May, 2023 1 commit
  8. 19 May, 2023 2 commits
    • Matt's avatar
      TF port of the Segment Anything Model (SAM) (#22970) · 1c460a52
      Matt authored
      
      
      * First commit
      
      * Add auto-translation with GPT-4
      
      * make fixup
      
      * Add a functional layernorm for TF
      
      * Add all the auxiliary imports etc.
      
      * Add the extra processor and tests
      
      * rebase to main
      
      * Add all the needed fixes to the GPT code
      
      * make fixup
      
      * Make convolutions channels-last so they run on CPU
      
      * make fixup
      
      * Fix final issues
      
      * Fix other models affected by test change
      
      * Clarify comment on the sparse_prompt_embeddings check
      
      * Refactor functional_layernorm, use shape_list in place of .shape in some places
      
      * Remove deprecated torch-alike code
      
      * Update tests/models/sam/test_modeling_tf_sam.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Update tests/models/sam/test_modeling_tf_sam.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Refactor processor with common methods and separated private methods
      
      * make fixup
      
      * Quietly delete the file that didn't do anything (sorry Sylvain)
      
      * Refactor the processor tests into one file
      
      * make fixup
      
      * Clean up some unnecessary indirection
      
      * Fix TF mask postprocessing
      
      * Add more processor equivalence tests
      
      * Refactor generate_crop_boxes to use framework-neutral np code
      
      * Make the serving output correctly conditional
      
      * Fix error message line length
      
      * Use dict keys rather than indices internally in both TF and PT SAM call/forward
      
      * Return dicts internally in the call/forward methods
      
      * Revert changes to common tests and just override check_pt_tf_outputs
      
      * Revert changes to other model tests
      
      * Clarify comments for functional layernorm
      
      * Add missing transpose from PT code
      
      * Removed unused copied from in PT code
      
      * Remove overrides for tests that don't exist in TF
      
      * Fix transpose and update tests for PT and TF to check pred_masks
      
      * Add training flag
      
      * Update tests to use TF checkpoints
      
      * Update index.mdx
      
      * Add missing cross-test decorator
      
      * Remove optional extra asterisks
      
      * Revert return_dict changes in PT code
      
      * Update src/transformers/models/sam/modeling_tf_sam.py
      Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
      
      * Remove None return annotations on init methods
      
      * Update tests/models/sam/test_processor_sam.py
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * Fix input_boxes shapes
      
      * make fixup
      
      ---------
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
      1c460a52
    • Julien Chaumond's avatar
      README: Fix affiliation for MEGA (#23394) · 3cf01b20
      Julien Chaumond authored
      
      
      * README: Fix affiliation for MEGA
      
      * Fix quality
      
      ---------
      Co-authored-by: default avatarLysandre <lysandre@huggingface.co>
      3cf01b20
  9. 18 May, 2023 3 commits
  10. 16 May, 2023 3 commits
  11. 15 May, 2023 1 commit
  12. 12 May, 2023 1 commit
  13. 11 May, 2023 5 commits
  14. 10 May, 2023 6 commits
    • Yih-Dar's avatar
      Bring back the PR `Refactor doctests + add CI` to `main` (#23271) · 9088fcae
      Yih-Dar authored
      * Revert "Revert "[Doctests] Refactor doctests + add CI" (#23245)"
      
      This reverts commit 69ee4624
      
      .
      
      * try not expose HfDocTestParser
      
      * move into testing_utils.py
      
      * remove pytest install
      
      ---------
      Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      9088fcae
    • Sylvain Gugger's avatar
      Render custom tool docs a bit better (#23269) · eb5b5ce6
      Sylvain Gugger authored
      * Try on a couple of blocks to see
      
      * Build the doc please
      
      * Build the doc please
      
      * Build the doc please
      
      * add more
      
      * Finish with all
      
      * Style
      eb5b5ce6
    • Sylvain Gugger's avatar
      Refine documentation for Tools (#23266) · f93509b1
      Sylvain Gugger authored
      * refine documentation for Tools
      
      * + one bugfix
      f93509b1
    • Patrick von Platen's avatar
      Improve Docs of Custom Tools and Agents (#23255) · 996f127a
      Patrick von Platen authored
      * Improve docs
      
      * correct tip format
      
      * Apply suggestions from code review
      
      * Apply suggestions from code review
      
      * Apply suggestions from code review
      
      * Correct grammer & spelling
      
      * Improve code style
      
      * make style ruff
      
      * make style final
      996f127a
    • Maria Khalusova's avatar
      [docs] Audio task guides fixes (#23239) · d3cbc997
      Maria Khalusova authored
      trainer parameters fixed
      d3cbc997
    • Sylvain Gugger's avatar
      Test composition (#23214) · 33357243
      Sylvain Gugger authored
      
      
      * Remove nestedness in tool config
      
      * Really do it
      
      * Use remote tools descriptions
      
      * Work
      
      * Clean up eval
      
      * Changes
      
      * Tools
      
      * Tools
      
      * tool
      
      * Fix everything
      
      * Use last result/assign for evaluation
      
      * Prompt
      
      * Remove hardcoded selection
      
      * Evaluation for chat agents
      
      * correct some spelling
      
      * Small fixes
      
      * Change summarization model (#23172)
      
      * Fix link displayed
      
      * Update description of the tool
      
      * Fixes in chat prompt
      
      * Custom tools, custom prompt
      
      * Tool clean up
      
      * save_pretrained and push_to_hub for tool
      
      * Fix init
      
      * Tests
      
      * Fix tests
      
      * Tool save/from_hub/push_to_hub and tool->load_tool
      
      * Clean push_to_hub and add app file
      
      * Custom inference API for endpoints too
      
      * Clean up
      
      * old remote tool and new remote tool
      
      * Make a requirements
      
      * return_code adds tool creation
      
      * Avoid redundancy between global variables
      
      * Remote tools can be loaded
      
      * Tests
      
      * Text summarization tests
      
      * Quality
      
      * Properly mark tests
      
      * Test the python interpreter
      
      * And the CI shall be green.
      
      * fix loading of additional tools
      
      * Work on RemoteTool and fix tests
      
      * General clean up
      
      * Guard imports
      
      * Fix tools
      
      * docs: Fix broken link in 'How to add a model...'  (#23216)
      
      fix link
      
      * Get default endpoint from the Hub
      
      * Add guide
      
      * Simplify tool config
      
      * Docs
      
      * Some fixes
      
      * Docs
      
      * Docs
      
      * Docs
      
      * Fix code returned by agent
      
      * Try this
      
      * Match args with signature in remote tool
      
      * Should fix python interpreter for Python 3.8
      
      * Fix push_to_hub for tools
      
      * Other fixes to push_to_hub
      
      * Add API doc page
      
      * Docs
      
      * Docs
      
      * Custom tools
      
      * Pin tensorflow-probability (#23220)
      
      * Pin tensorflow-probability
      
      * [all-test]
      
      * [all-test] Fix syntax for bash
      
      * PoC for some chaining API
      
      * Text to speech
      
      * J'ai pris des libert茅s
      
      * Rename
      
      * Basic python interpreter
      
      * Add agents
      
      * Quality
      
      * Add translation tool
      
      * temp
      
      * GenQA + LID + S2T
      
      * Quality + word missing in translation
      
      * Add open assistance, support f-strings in evaluate
      
      * captioning + s2t fixes
      
      * Style
      
      * Refactor descriptions and remove chain
      
      * Support errors and rename OpenAssistantAgent
      
      * Add setup
      
      * Deal with typos + example of inference API
      
      * Some rename + README
      
      * Fixes
      
      * Update prompt
      
      * Unwanted change
      
      * Make sure everyone has a default
      
      * One prompt to rule them all.
      
      * SD
      
      * Description
      
      * Clean up remote tools
      
      * More remote tools
      
      * Add option to return code and update doc
      
      * Image segmentation
      
      * ControlNet
      
      * Gradio demo
      
      * Diffusers protection
      
      * Lib protection
      
      * ControlNet description
      
      * Cleanup
      
      * Style
      
      * Remove accelerate and try to be reproducible
      
      * No randomness
      
      * Male Basic optional in token
      
      * Clean description
      
      * Better prompts
      
      * Fix args eval in interpreter
      
      * Add tool wrapper
      
      * Tool on the Hub
      
      * Style post-rebase
      
      * Big refactor of descriptions, batch generation and evaluation for agents
      
      * Make problems easier - interface to debug
      
      * More problems, add python primitives
      
      * Back to one prompt
      
      * Remove dict for translation
      
      * Be consistent
      
      * Add prompts
      
      * New version of the agent
      
      * Evaluate new agents
      
      * New endpoints agents
      
      * Make all tools a dict variable
      
      * Typo
      
      * Add problems
      
      * Add to big prompt
      
      * Harmonize
      
      * Add tools
      
      * New evaluation
      
      * Add more tools
      
      * Build prompt with tools descriptions
      
      * Tools on the Hub
      
      * Let's chat!
      
      * Cleanup
      
      * Temporary bs4 safeguard
      
      * Cache agents and clean up
      
      * Blank init
      
      * Fix evaluation for agents
      
      * New format for tools on the Hub
      
      * Add method to reset state
      
      * Remove nestedness in tool config
      
      * Really do it
      
      * Use remote tools descriptions
      
      * Work
      
      * Clean up eval
      
      * Changes
      
      * Tools
      
      * Tools
      
      * tool
      
      * Fix everything
      
      * Use last result/assign for evaluation
      
      * Prompt
      
      * Remove hardcoded selection
      
      * Evaluation for chat agents
      
      * correct some spelling
      
      * Small fixes
      
      * Change summarization model (#23172)
      
      * Fix link displayed
      
      * Update description of the tool
      
      * Fixes in chat prompt
      
      * Custom tools, custom prompt
      
      * Tool clean up
      
      * save_pretrained and push_to_hub for tool
      
      * Fix init
      
      * Tests
      
      * Fix tests
      
      * Tool save/from_hub/push_to_hub and tool->load_tool
      
      * Clean push_to_hub and add app file
      
      * Custom inference API for endpoints too
      
      * Clean up
      
      * old remote tool and new remote tool
      
      * Make a requirements
      
      * return_code adds tool creation
      
      * Avoid redundancy between global variables
      
      * Remote tools can be loaded
      
      * Tests
      
      * Text summarization tests
      
      * Quality
      
      * Properly mark tests
      
      * Test the python interpreter
      
      * And the CI shall be green.
      
      * Work on RemoteTool and fix tests
      
      * fix loading of additional tools
      
      * General clean up
      
      * Guard imports
      
      * Fix tools
      
      * Get default endpoint from the Hub
      
      * Simplify tool config
      
      * Add guide
      
      * Docs
      
      * Some fixes
      
      * Docs
      
      * Docs
      
      * Fix code returned by agent
      
      * Try this
      
      * Docs
      
      * Match args with signature in remote tool
      
      * Should fix python interpreter for Python 3.8
      
      * Fix push_to_hub for tools
      
      * Other fixes to push_to_hub
      
      * Add API doc page
      
      * Fixes
      
      * Doc fixes
      
      * Docs
      
      * Fix audio
      
      * Custom tools
      
      * Audio fix
      
      * Improve custom tools docstring
      
      * Docstrings
      
      * Trigger CI
      
      * Mode docstrings
      
      * More docstrings
      
      * Improve custom tools
      
      * Fix for remote tools
      
      * Style
      
      * Fix repo consistency
      
      * Quality
      
      * Tip
      
      * Cleanup on doc
      
      * Cleanup toc
      
      * Add disclaimer for starcoder vs openai
      
      * Remove disclaimer
      
      * Small fixed in the prompts
      
      * 4.29
      
      * Update src/transformers/tools/agents.py
      Co-authored-by: default avatarLysandre Debut <lysandre.debut@reseau.eseo.fr>
      
      * Complete documentation
      
      * Small fixes
      
      * Agent evaluation
      
      * Note about gradio-tools & LC
      
      * Clean up agents and prompt
      
      * Apply suggestions from code review
      Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
      
      * Apply suggestions from code review
      Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
      
      * Note about gradio-tools & LC
      
      * Add copyrights and address review comments
      
      * Quality
      
      * Add all language codes
      
      * Add remote tool tests
      
      * Move custom prompts to other docs
      
      * Apply suggestions from code review
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * TTS tests
      
      * Quality
      
      ---------
      Co-authored-by: default avatarLysandre <hi@lyand.re>
      Co-authored-by: default avatarPatrick von Platen <patrick.v.platen@gmail.com>
      Co-authored-by: default avatarPhilipp Schmid <32632186+philschmid@users.noreply.github.com>
      Co-authored-by: default avatarConnor Henderson <connor.henderson@talkiatry.com>
      Co-authored-by: default avatarLysandre <lysandre.debut@reseau.eseo.fr>
      Co-authored-by: default avatarLysandre <lysandre@huggingface.co>
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      33357243
  15. 09 May, 2023 2 commits
    • Sylvain Gugger's avatar
      Revert "[Doctests] Refactor doctests + add CI" (#23245) · 69ee4624
      Sylvain Gugger authored
      Revert "[Doctests] Refactor doctests + add CI (#22987)"
      
      This reverts commit 627f4479.
      69ee4624
    • Arthur's avatar
      [Doctests] Refactor doctests + add CI (#22987) · 627f4479
      Arthur authored
      
      
      * intiial commit
      
      * new styling
      
      * update
      
      * just run doctest in CI
      
      * remove more test for fast dev
      
      * update
      
      * update refs
      
      * update path and fetch upstream
      
      * update documentatyion trests
      
      * typo
      
      * parse pwd
      
      * don't check for files that are in hidden folders
      
      * just give paths relative to transformers
      
      * update
      
      * update
      
      * update
      
      * major refactoring
      
      * make sure options is ok
      
      * lest test that mdx is tested
      
      * doctest glob
      
      * nits
      
      * update doctest nightly
      
      * some cleaning
      
      * run correct test on diff
      
      * debug
      
      * run on a single worker
      
      * skip_cuda_test tampkate
      
      * updates
      
      * add rA and continue on failure
      
      * test options
      
      * parse `py` codeblock?
      
      * we don't need to replace ignore results, don't remember whyu I put it
      
      * cleanup
      
      * more cleaning
      
      * fix arg
      
      * more cleaning
      
      * clean an todo
      
      * more pre-processing
      
      * doctest-module has none so extra `- ` is needed
      
      * remove logs
      
      * nits
      
      * doctest-modules ....
      
      * oups
      
      * let's use sugar
      
      * make dataset go quiet
      
      * add proper timeout
      
      * nites
      
      * spleling timeout
      
      * update
      
      * properly skip tests that have CUDSA
      
      * proper skipping
      
      * cleaning main and get tests to run
      
      * remove make report?
      
      * remove tee
      
      * some updates
      
      * tee was removed but is the full output still available?
      
      * [all-test]
      
      * only our tests
      
      * don't  touch tee in this PR
      
      * no atee-sys
      
      * proper sub
      
      * monkey
      
      * only replace call
      
      * fix sub
      
      * nits
      
      * nits
      
      * fix invalid syntax
      
      * add skip cuda doctest env variable
      
      * make sure all packages are installed
      
      * move file
      
      * update check repo
      
      * revert changes
      
      * nit
      
      * finish cleanup
      
      * fix re
      
      * findall
      
      * update don't test init files
      
      * ignore pycache
      
      * `-ignore-pycache` when running pytests
      
      * try to fix the import missmatch error
      
      * install dec
      
      * pytest is required as doctest_utils imports things from it
      
      * the only log issues were dataset, ignore results should work
      
      * more cleaning
      
      * Update .circleci/create_circleci_config.py
      Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
      
      * Apply suggestions from code review
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      
      * [ydshieh] empty string if cuda is found
      
      * [ydshieh] fix condition
      
      * style
      
      * [ydshieh] fix
      
      * Add comment
      
      * style
      
      * style
      
      * show failure
      
      * trigger CI
      
      ---------
      Co-authored-by: default avatarSylvain Gugger <35901082+sgugger@users.noreply.github.com>
      Co-authored-by: default avatarYih-Dar <2521628+ydshieh@users.noreply.github.com>
      Co-authored-by: default avataramyeroberts <22614925+amyeroberts@users.noreply.github.com>
      Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      627f4479