Skip to content

GitLab

"benchmark/git@developer.sourcefind.cn:zhaoyu6/sglang.git" did not exist on "b9c87e781dd1e061090ce5e99eca2d6cc448b97f"
Switch branch/tag
  1. 23 Nov, 2023 1 commit
  3. 13 Nov, 2023 1 commit
  5. 31 Oct, 2023 1 commit
  7. 24 Oct, 2023 1 commit
  9. 06 Oct, 2023 1 commit
  11. 25 Sep, 2023 1 commit
  13. 21 Sep, 2023 1 commit
  15. 19 Sep, 2023 1 commit
  17. 14 Sep, 2023 1 commit
  19. 05 Sep, 2023 1 commit
  21. 29 Aug, 2023 1 commit
  23. 24 Aug, 2023 1 commit
  25. 11 Aug, 2023 1 commit
  27. 09 Aug, 2023 1 commit
  29. 08 Aug, 2023 1 commit
  31. 03 Aug, 2023 1 commit
  33. 31 Jul, 2023 1 commit
  35. 28 Jul, 2023 1 commit
  37. 30 Jun, 2023 1 commit
  39. 28 Jun, 2023 1 commit
  41. 20 Jun, 2023 3 commits
  43. 16 Jun, 2023 1 commit
    • Matt's avatar
      Add test for proper TF input signatures (#24320) · 91389950
      Matt authored 
      * Add test for proper input signatures

* No more signature pruning

* Test the dummy inputs are valid too

* fine-tine -> fine-tune

* Fix indent in test_dataset_conversion
      91389950
  45. 13 Jun, 2023 1 commit
    • Matt's avatar
      Stop storing references to bound methods via tf.function (#24146) · 3bd1fe43
      Matt authored 
      * Stop storing references to bound methods in tf.functions

* Remove the gc.collect calls now that we resolved the underlying problem

* Remove the default signature from model.serving entirely, big cleanup

* Remove _prune_signature as self.input_signature can prune itself

* Restore serving docstring

* Update int support test to check the input signature

* Make sure other tests also use model.input_signature and not serving.input_signature

* Restore _prune_signature

* Remove the doctest GC now it's no longer needed

* Correct core tests to use the pruned sig

* order lines correctly in core tests

* Add eager_serving back with a deprecation warning
      3bd1fe43
  47. 08 Jun, 2023 1 commit
  49. 24 May, 2023 2 commits
    • Daniel King's avatar
      Fix the regex in `get_imports` to support multiline try blocks and excepts... · 89159651
      Daniel King authored 
      Fix the regex in `get_imports` to support multiline try blocks and excepts with specific exception types (#23725)

* fix and test get_imports for multiline try blocks, and excepts with specific errors

* fixup

* add some more tests

* add license
      89159651
    • Matt's avatar
      Better TF docstring types (#23477) · f8b25744
      Matt authored 
      * Rework TF type hints to use | None instead of Optional[] for tf.Tensor

* Rework TF type hints to use | None instead of Optional[] for tf.Tensor

* Don't forget the imports

* Add the imports to tests too

* make fixup

* Refactor tests that depended on get_type_hints

* Better test refactor

* Fix an old hidden bug in the test_keras_fit input creation code

* Fix for the Deit tests
      f8b25744
  51. 18 May, 2023 1 commit
  53. 09 May, 2023 1 commit
    • Matthijs Hollemans's avatar
      audio_utils improvements (#21998) · 7f919509
      Matthijs Hollemans authored 
      * silly change to allow making a PR

* clean up doc comments

* simplify hertz_to_mel and mel_to_hertz

* fixup

* clean up power_to_db

* also add amplitude_to_db

* move functions

* clean up mel_filter_bank

* fixup

* credit librosa & torchaudio authors

* add unit tests

* tests for power_to_db and amplitude_to_db

* add mel_filter_bank tests

* rewrite STFT

* add convenience spectrogram function

* missing transpose

* fewer transposes

* add integration test to M-CTC-T

* frame length can be either window or FFT length

* rewrite stft API

* add preemphasis coefficient

* move argument

* add log option to spectrogram

* replace M-CTC-T feature extractor

* fix api thing

* replace whisper STFT

* replace whisper mel filters

* replace tvlt's stft

* allow alternate window names

* replace speecht5 stft

* fixup

* fix integration tests

* fix doc comments

* remove manual FFT length calculation

* fix docs

* go away, deprecation warnings

* combine everything into spectrogram function

* add deprecated functions back

* fixup
      7f919509
  55. 04 May, 2023 1 commit
    • amyeroberts's avatar
      Add methods to update and verify out_features out_indices (#23031) · 90e8263d
      amyeroberts authored 
      * Add methods to update and verify out_features out_indices

* Safe update for config attributes

* Fix function names

* Save config correctly

* PR comments - use property setters

* PR comment - directly set attributes

* Update test

* Add updates to recently merged focalnet backbone
      90e8263d
  57. 03 May, 2023 1 commit
  59. 27 Apr, 2023 1 commit
  61. 25 Apr, 2023 1 commit
  63. 24 Apr, 2023 2 commits
  65. 10 Apr, 2023 1 commit
  67. 06 Apr, 2023 3 commits
    • Yih-Dar's avatar
      Update tiny model summary file for recent models (#22637) · c7ec71ba
      Yih-Dar authored 
      

* Update tiny model summary file for recent models

---------
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
      c7ec71ba
    • Nicolas Patry's avatar
      Revert error back into warning for byte fallback conversion. (#22607) · 0aa1153f
      Nicolas Patry authored
      0aa1153f
    • Nicolas Patry's avatar
      Adding Llama FastTokenizer support. (#22264) · 1670be4b
      Nicolas Patry authored 
      * Adding Llama FastTokenizer support.

- Requires https://github.com/huggingface/tokenizers/pull/1183 version
- Only support byte_fallback for llama, raise otherwise (safety net).
- Lots of questions are special tokens

How to test:

```python

from transformers.convert_slow_tokenizer import convert_slow_tokenizer
from transformers import AutoTokenizer
from tokenizers import Tokenizer

tokenizer = AutoTokenizer.from_pretrained("huggingface/llama-7b")

if False:
    new_tokenizer = Tokenizer.from_file("tok.json")
else:
    new_tokenizer = convert_slow_tokenizer(tokenizer)
    new_tokenizer.save("tok.json")

strings = [
    "This is a test",
    "生活的真谛是",
    "生活的真谛是[MASK]。",
    # XXX: This one is problematic because of special tokens
    # "<s> Something something",
]

for string in strings:
    encoded = tokenizer(string)["input_ids"]
    encoded2 = new_tokenizer.encode(string).ids

    assert encoded == encoded2, f"{encoded} != {encoded2}"

    decoded = tokenizer.decode(encoded)
    decoded2 = new_tokenizer.decode(encoded2)

    assert decoded.strip() == decoded2, f"{repr(decoded)} != {repr(decoded2)}"
```

The converter + some test script.

The test script.

Tmp save.

Adding Fast tokenizer + tests.

Adding the tokenization tests.

Correct combination.

Small fix.

Fixing tests.

Fixing with latest update.

Rebased.

fix copies + normalized added tokens  + copies.

Adding doc.

TMP.

Doc + split files.

Doc.

Versions + try import.

Fix Camembert + warnings -> Error.

Fix by ArthurZucker.

Not a decorator.

* Fixing comments.

* Adding more to docstring.

* Doc rewriting.
      1670be4b