Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
bbaa8cef
Unverified
Commit
bbaa8cef
authored
May 01, 2024
by
amyeroberts
Committed by
GitHub
May 01, 2024
Browse files
Fix canonical model --model_type in examples (#30480)
Fix --model_type in examples
parent
3c69d81e
Changes
7
Show whitespace changes
Inline
Side-by-side
Showing
7 changed files
with
52 additions
and
52 deletions
+52
-52
docs/source/es/converting_tensorflow_models.md
docs/source/es/converting_tensorflow_models.md
+1
-1
docs/source/it/converting_tensorflow_models.md
docs/source/it/converting_tensorflow_models.md
+13
-13
docs/source/pt/converting_tensorflow_models.md
docs/source/pt/converting_tensorflow_models.md
+3
-3
examples/README.md
examples/README.md
+8
-8
examples/flax/language-modeling/README.md
examples/flax/language-modeling/README.md
+25
-25
examples/pytorch/language-modeling/README.md
examples/pytorch/language-modeling/README.md
+1
-1
examples/pytorch/text-generation/README.md
examples/pytorch/text-generation/README.md
+1
-1
No files found.
docs/source/es/converting_tensorflow_models.md
View file @
bbaa8cef
...
@@ -89,7 +89,7 @@ Aquí hay un ejemplo del proceso para convertir un modelo OpenAI GPT-2 pre-entre
...
@@ -89,7 +89,7 @@ Aquí hay un ejemplo del proceso para convertir un modelo OpenAI GPT-2 pre-entre
```
bash
```
bash
export
OPENAI_GPT2_CHECKPOINT_PATH
=
/path/to/openai-community/gpt2/pretrained/weights
export
OPENAI_GPT2_CHECKPOINT_PATH
=
/path/to/openai-community/gpt2/pretrained/weights
transformers-cli convert
--model_type
openai-community/
gpt2
\
transformers-cli convert
--model_type
gpt2
\
--tf_checkpoint
$OPENAI_GPT2_CHECKPOINT_PATH
\
--tf_checkpoint
$OPENAI_GPT2_CHECKPOINT_PATH
\
--pytorch_dump_output
$PYTORCH_DUMP_OUTPUT
\
--pytorch_dump_output
$PYTORCH_DUMP_OUTPUT
\
[
--config
OPENAI_GPT2_CONFIG]
\
[
--config
OPENAI_GPT2_CONFIG]
\
...
...
docs/source/it/converting_tensorflow_models.md
View file @
bbaa8cef
...
@@ -97,7 +97,7 @@ Ecco un esempio del processo di conversione di un modello OpenAI GPT-2 pre-allen
...
@@ -97,7 +97,7 @@ Ecco un esempio del processo di conversione di un modello OpenAI GPT-2 pre-allen
```
bash
```
bash
export
OPENAI_GPT2_CHECKPOINT_PATH
=
/path/to/openai-community/gpt2/pretrained/weights
export
OPENAI_GPT2_CHECKPOINT_PATH
=
/path/to/openai-community/gpt2/pretrained/weights
transformers-cli convert
--model_type
openai-community/
gpt2
\
transformers-cli convert
--model_type
gpt2
\
--tf_checkpoint
$OPENAI_GPT2_CHECKPOINT_PATH
\
--tf_checkpoint
$OPENAI_GPT2_CHECKPOINT_PATH
\
--pytorch_dump_output
$PYTORCH_DUMP_OUTPUT
\
--pytorch_dump_output
$PYTORCH_DUMP_OUTPUT
\
[
--config
OPENAI_GPT2_CONFIG]
\
[
--config
OPENAI_GPT2_CONFIG]
\
...
...
docs/source/pt/converting_tensorflow_models.md
View file @
bbaa8cef
...
@@ -102,7 +102,7 @@ Aqui está um exemplo do processo de conversão para um modelo OpenAI GPT-2 pré
...
@@ -102,7 +102,7 @@ Aqui está um exemplo do processo de conversão para um modelo OpenAI GPT-2 pré
```
bash
```
bash
export
OPENAI_GPT2_CHECKPOINT_PATH
=
/path/to/openai-community/gpt2/pretrained/weights
export
OPENAI_GPT2_CHECKPOINT_PATH
=
/path/to/openai-community/gpt2/pretrained/weights
transformers-cli convert
--model_type
openai-community/
gpt2
\
transformers-cli convert
--model_type
gpt2
\
--tf_checkpoint
$OPENAI_GPT2_CHECKPOINT_PATH
\
--tf_checkpoint
$OPENAI_GPT2_CHECKPOINT_PATH
\
--pytorch_dump_output
$PYTORCH_DUMP_OUTPUT
\
--pytorch_dump_output
$PYTORCH_DUMP_OUTPUT
\
[
--config
OPENAI_GPT2_CONFIG]
\
[
--config
OPENAI_GPT2_CONFIG]
\
...
...
examples/README.md
View file @
bbaa8cef
...
@@ -118,7 +118,7 @@ pip install runhouse
...
@@ -118,7 +118,7 @@ pip install runhouse
# For an on-demand V100 with whichever cloud provider you have configured:
# For an on-demand V100 with whichever cloud provider you have configured:
python run_on_remote.py
\
python run_on_remote.py
\
--example
pytorch/text-generation/run_generation.py
\
--example
pytorch/text-generation/run_generation.py
\
--model_type
=
openai-community/
gpt2
\
--model_type
=
gpt2
\
--model_name_or_path
=
openai-community/gpt2
\
--model_name_or_path
=
openai-community/gpt2
\
--prompt
"I am a language model and"
--prompt
"I am a language model and"
...
...
examples/flax/language-modeling/README.md
View file @
bbaa8cef
...
@@ -199,7 +199,7 @@ Finally, we can run the example script to pretrain the model:
...
@@ -199,7 +199,7 @@ Finally, we can run the example script to pretrain the model:
```
bash
```
bash
python run_clm_flax.py
\
python run_clm_flax.py
\
--output_dir
=
"./norwegian-gpt2"
\
--output_dir
=
"./norwegian-gpt2"
\
--model_type
=
"
openai-community/
gpt2"
\
--model_type
=
"gpt2"
\
--config_name
=
"./norwegian-gpt2"
\
--config_name
=
"./norwegian-gpt2"
\
--tokenizer_name
=
"./norwegian-gpt2"
\
--tokenizer_name
=
"./norwegian-gpt2"
\
--dataset_name
=
"oscar"
\
--dataset_name
=
"oscar"
\
...
...
examples/pytorch/language-modeling/README.md
View file @
bbaa8cef
...
@@ -239,7 +239,7 @@ When training a model from scratch, configuration values may be overridden with
...
@@ -239,7 +239,7 @@ When training a model from scratch, configuration values may be overridden with
```
bash
```
bash
python run_clm.py
--model_type
openai-community/
gpt2
--tokenizer_name
openai-community/gpt2
\
--config_overrides
=
"n_embd=1024,n_head=16,n_layer=48,n_positions=102"
\
python run_clm.py
--model_type
gpt2
--tokenizer_name
openai-community/gpt2
\
--config_overrides
=
"n_embd=1024,n_head=16,n_layer=48,n_positions=102"
\
[
...]
[
...]
```
```
...
...
examples/pytorch/text-generation/README.md
View file @
bbaa8cef
...
@@ -26,6 +26,6 @@ Example usage:
...
@@ -26,6 +26,6 @@ Example usage:
```
bash
```
bash
python run_generation.py
\
python run_generation.py
\
--model_type
=
openai-community/
gpt2
\
--model_type
=
gpt2
\
--model_name_or_path
=
openai-community/gpt2
--model_name_or_path
=
openai-community/gpt2
```
```
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment