"experimental/vscode:/vscode.git/clone" did not exist on "3b727945a6461fa2a870ad62ba4581a1dd6fca93"
  • drbh's avatar
    fix: tokenizer config should use local model path when possible (#1518) · ee1cf51c
    drbh authored
    
    
    This PR fixes the issue with loading a local tokenizer config.
    Previously the default functionality would look in the current working
    directory. Now if a local model path is specified we will check that
    directory for the tokenizer_config.
    
    ## Examples of valid commands
    
    uses tokenizer_config from hub
    ```
    text-generation-launcher --model-id HuggingFaceH4/zephyr-7b-beta
    ```
    
    use tokenizer_config from local model path
    ```
    text-generation-launcher \
      --model-id ~/.cache/huggingface/hub/models--HuggingFaceH4--zephyr-7b-beta/snapshots/dc24cabd13eacd3ae3a5fe574bd645483a335a4a/
    ```
    
    use specific tokenizer_config file
    ```
     text-generation-launcher \
      --model-id ~/.cache/huggingface/hub/models--HuggingFaceH4--zephyr-7b-beta/snapshots/dc24cabd13eacd3ae3a5fe574bd645483a335a4a/ \
      --tokenizer-config-path ~/.cache/huggingface/hub/models--HuggingFaceH4--zephyr-7b-beta/snapshots/dc24cabd13eacd3ae3a5fe574bd645483a335a4a/tokenizer_config.json
    
    
    ```
    
    ---------
    Co-authored-by: default avatarNicolas Patry <patry.nicolas@protonmail.com>
    ee1cf51c
main.rs 17.2 KB