Commits · e05baad86119efcbf1e2dae64eef0c29f589b07b · chenpangpang / transformers

"tests/models/tvp/test_image_processing_tvp.py" did not exist on "a6b77598805f4e3c24a47767d503dc6ea20d1381"

14 May, 2024 1 commit

Add Watermarking LogitsProcessor and WatermarkDetector (#29676) · 5ad960f1

Raushan Turganbay authored May 14, 2024



* add watermarking processor

* remove the other hashing (context width=1 always)

* make style

* Update src/transformers/generation/logits_process.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/logits_process.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/logits_process.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/configuration_utils.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* update watermarking process

* add detector

* update tests to use detector

* fix failing tests

* rename `input_seq`

* make style

* doc for processor

* minor fixes

* docs

* make quality

* Update src/transformers/generation/configuration_utils.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/logits_process.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/watermarking.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/watermarking.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/watermarking.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* add PR suggestions

* let's use lru_cache's default max size (128)

* import processor if torch available

* maybe like this

* lets move the config to torch independet file

* add docs

* tiny docs fix to make the test happy

* Update src/transformers/generation/configuration_utils.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Update src/transformers/generation/watermarking.py
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* PR suggestions

* add docs

* fix test

* fix docs

* address pr comments

* style

* Revert "style"

This reverts commit 7f33cc34ff08b414f8e7f90060889877606b43b2.

* correct style

* make doctest green

---------
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

5ad960f1

02 May, 2024 1 commit
- Docs: fix `generate`-related rendering issues (#30600) · aa55ff44
  Joao Gante authored May 02, 2024
```
* does this work?

* like this?

* fix the other generate links

* missing these
```
  aa55ff44
15 Apr, 2024 1 commit
- Fix doctest more (for `docs/source/en`) (#30247) · fe2d20d2
  Yih-Dar authored Apr 15, 2024
```
* fix

* fix

---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
```
  fe2d20d2
28 Mar, 2024 1 commit
- Add beam search visualizer to the doc (#29876) · c9d2e855
  Aymeric Roucher authored Mar 28, 2024
  
  c9d2e855
05 Mar, 2024 1 commit
- Generate: inner decoding methods are no longer public (#29437) · 87a0783d
  Joao Gante authored Mar 05, 2024
  
  87a0783d
16 Feb, 2024 1 commit
- Update all references to canonical models (#29001) · f497f564
  Lysandre Debut authored Feb 16, 2024
```
* Script & Manual edition

* Update
```
  f497f564
20 Dec, 2023 1 commit
- Generate: fix speculative decoding (#28166) · 45b70384
  Joao Gante authored Dec 20, 2023
```
Co-authored-by: Merve Noyan <merveenoyan@gmail.com>
```
  45b70384
29 Sep, 2023 1 commit
- [docs] navigation improvement between text gen pipelines and text gen params (#26477) · 14170b78
  Maria Khalusova authored Sep 29, 2023
```
* navigation improvement between text generation pipelines and text generation docs

* make style
```
  14170b78
12 Sep, 2023 1 commit
- Generate: legacy mode is only triggered when `generation_config` is untouched (#25962) · 3319eb54
  Joao Gante authored Sep 12, 2023
  
  3319eb54
04 Sep, 2023 1 commit

Fix typos (#25936) · 0f0e1a2c

omahs authored Sep 04, 2023

* fix typo

* fix typo

* fix typo

* fix typos

* fix typos

* fix typo

* fix typo

* fix typo

* fix typos

* fix typo

* fix typo

* fix typo

* fix typos

* fix typos

0f0e1a2c

30 Aug, 2023 1 commit
- Docs: fix example failing doctest in `generation_strategies.md ` (#25874) · 459bc673
  Joao Gante authored Aug 30, 2023
  
  459bc673
29 Aug, 2023 1 commit
- Tests: detect lines removed from "utils/not_doctested.txt" and doctest ALL... · a35f889a
  Joao Gante authored Aug 29, 2023
```
Tests: detect lines removed from "utils/not_doctested.txt" and doctest ALL generation files (#25763)
```
  a35f889a
27 Jun, 2023 1 commit
- Generate: `group_beam_search` requires `diversity_penalty>0.0` (#24456) · 5f3efdf7
  Joao Gante authored Jun 27, 2023
```
* add exception

* update docs
```
  5f3efdf7
20 Jun, 2023 1 commit

Migrate doc files to Markdown. (#24376) · eb849f66

Sylvain Gugger authored Jun 20, 2023



* Rename index.mdx to index.md

* With saved modifs

* Address review comment

* Treat all files

* .mdx -> .md

* Remove special char

* Update utils/tests_fetcher.py
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

---------
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

eb849f66

16 May, 2023 1 commit
- Docs: add link to assisted generation blog post (#23397) · 5b1ad0eb
  Joao Gante authored May 16, 2023
  
  5b1ad0eb
24 Apr, 2023 1 commit
- Generate: assisted generation with sample (take 2) (#22949) · e4a97f82
  Joao Gante authored Apr 24, 2023
```
* temperature controls speed
```
  e4a97f82
18 Apr, 2023 1 commit

Generate: Add assisted generation (#22211) · 78cda46f

Joao Gante authored Apr 18, 2023

* working mvp

* remove breakpoint

* fix commit

* standardize outputs

* tmp commit

* tests almost ready

* tmp commit

* skip a few models

* Add streaming; Docs and examples

* document limitations

* PR commits

* Amy PR comments

78cda46f

07 Apr, 2023 1 commit
- Generate: add API warning to streamers (#22659) · 3f96e0b4
  Joao Gante authored Apr 07, 2023
```
add API warning
```
  3f96e0b4
30 Mar, 2023 2 commits
- Docs fix: Multinomial sampling decoding needs "num_beams=1", since by default... · d5de578c
  Manuel de Prada authored Mar 30, 2023
```
Docs fix: Multinomial sampling decoding needs "num_beams=1", since by default it is usually not 1. (#22473)

Fix: Multinomial sampling needs "num_beams=1", since by default is 5.
```
  d5de578c
- Generate: basic token streaming (#22449) · 228792a9
  Joao Gante authored Mar 30, 2023
```
* haha tokens go brrrr
```
  228792a9
24 Mar, 2023 1 commit
- Fix typo in Greedy Search Description (#22345) · b7960765
  Ashwin Mathur authored Mar 24, 2023
```
Fix typo in greedy search docs
```
  b7960765
17 Jan, 2023 1 commit

Add: An introductory guide for text generation (#21090) · d386fd64

Maria Khalusova authored Jan 17, 2023



* Part of the "text generation" rework: adding a high-level overview of the text generation strategies

* code samples update via make style

* fixed a few formatting issues

* Apply suggestions from review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fixed spaces, and switched two links to markdown

* Apply Steven's suggestions from review
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* new lines after headers to fix link rendering

* review feedback addressed. added links to image captioning and audio transcription examples

* minor capitalization fix

* addressed the review feedback

* Apply suggestions from review
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* Applied review suggestions
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

d386fd64