Unverified Commit 345a1371 authored by Matt's avatar Matt Committed by GitHub
Browse files

Fix TF example in quicktour (#22960)

* Fix TF example in quicktour

* Fix model.fit() and the dataset section too
parent 503e8c8b
...@@ -528,7 +528,7 @@ All models are a standard [`tf.keras.Model`](https://www.tensorflow.org/api_docs ...@@ -528,7 +528,7 @@ All models are a standard [`tf.keras.Model`](https://www.tensorflow.org/api_docs
```py ```py
>>> dataset = dataset.map(tokenize_dataset) # doctest: +SKIP >>> dataset = dataset.map(tokenize_dataset) # doctest: +SKIP
>>> tf_dataset = model.prepare_tf_dataset( >>> tf_dataset = model.prepare_tf_dataset(
... dataset, batch_size=16, shuffle=True, tokenizer=tokenizer ... dataset["train"], batch_size=16, shuffle=True, tokenizer=tokenizer
... ) # doctest: +SKIP ... ) # doctest: +SKIP
``` ```
...@@ -538,7 +538,7 @@ All models are a standard [`tf.keras.Model`](https://www.tensorflow.org/api_docs ...@@ -538,7 +538,7 @@ All models are a standard [`tf.keras.Model`](https://www.tensorflow.org/api_docs
>>> from tensorflow.keras.optimizers import Adam >>> from tensorflow.keras.optimizers import Adam
>>> model.compile(optimizer=Adam(3e-5)) >>> model.compile(optimizer=Adam(3e-5))
>>> model.fit(dataset) # doctest: +SKIP >>> model.fit(tf_dataset) # doctest: +SKIP
``` ```
## What's next? ## What's next?
......
...@@ -247,7 +247,7 @@ reduces the number of padding tokens compared to padding the entire dataset. ...@@ -247,7 +247,7 @@ reduces the number of padding tokens compared to padding the entire dataset.
```py ```py
>>> tf_dataset = model.prepare_tf_dataset(dataset, batch_size=16, shuffle=True, tokenizer=tokenizer) >>> tf_dataset = model.prepare_tf_dataset(dataset["train"], batch_size=16, shuffle=True, tokenizer=tokenizer)
``` ```
Note that in the code sample above, you need to pass the tokenizer to `prepare_tf_dataset` so it can correctly pad batches as they're loaded. Note that in the code sample above, you need to pass the tokenizer to `prepare_tf_dataset` so it can correctly pad batches as they're loaded.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment