Commit a8bccfa4 authored by A. Unique TensorFlower's avatar A. Unique TensorFlower
Browse files

Internal change

PiperOrigin-RevId: 422917125
parent 3a7e01c6
...@@ -57,7 +57,7 @@ def _truncate_row_lengths(ragged_tensor: tf.RaggedTensor, ...@@ -57,7 +57,7 @@ def _truncate_row_lengths(ragged_tensor: tf.RaggedTensor,
class BertTokenizer(tf.keras.layers.Layer): class BertTokenizer(tf.keras.layers.Layer):
"""Wraps BertTokenizer with pre-defined vocab as a Keras Layer. """Wraps TF.Text's BertTokenizer with pre-defined vocab as a Keras Layer.
Attributes: Attributes:
tokenize_with_offsets: If true, calls tokenize_with_offsets: If true, calls
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment