dcu1_sauad

nohup: ignoring input
/public/home/xuanbaby/rocm3.9-python3.6.8-tf1.15/bin/python3
/public/home/xuanbaby/rocm3.9-python3.6.8-tf1.15/lib/python3.6/site-packages/absl/flags/_validators.py:359: UserWarning: Flag --model_dir has a non-None default value; therefore, mark_flag_as_required will pass even if flag is not specified in the command line!
  'command line!' % flag_name)
2021-04-20 13:52:19.004111: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libamdhip64.so
2021-04-20 13:52:21.340214: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:21.340441: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 1 with properties: 
pciBusID: 0000:26:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:21.340561: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 2 with properties: 
pciBusID: 0000:43:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:21.340675: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 3 with properties: 
pciBusID: 0000:63:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:22.094548: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library librocblas.so
2021-04-20 13:52:22.625555: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libMIOpen.so
2021-04-20 13:52:24.123987: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library librocfft.so
2021-04-20 13:52:24.244932: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library librocrand.so
2021-04-20 13:52:24.246858: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0, 1, 2, 3
2021-04-20 13:52:24.541775: I tensorflow/core/platform/profile_utils/cpu_utils.cc:104] CPU Frequency: 1999885000 Hz
2021-04-20 13:52:24.546191: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x500d950 initialized for platform Host (this does not guarantee that XLA will be used). Devices:
2021-04-20 13:52:24.546299: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Host, Default Version
2021-04-20 13:52:24.593943: I tensorflow/compiler/xla/service/service.cc:168] XLA service 0x507a4c0 initialized for platform ROCM (this does not guarantee that XLA will be used). Devices:
2021-04-20 13:52:24.594019: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (0): Device 66a1, AMDGPU ISA version: gfx906
2021-04-20 13:52:24.594056: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (1): Device 66a1, AMDGPU ISA version: gfx906
2021-04-20 13:52:24.594089: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (2): Device 66a1, AMDGPU ISA version: gfx906
2021-04-20 13:52:24.594121: I tensorflow/compiler/xla/service/service.cc:176]   StreamExecutor device (3): Device 66a1, AMDGPU ISA version: gfx906
2021-04-20 13:52:29.917480: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 0 with properties: 
pciBusID: 0000:04:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:29.917676: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 1 with properties: 
pciBusID: 0000:26:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:29.917799: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 2 with properties: 
pciBusID: 0000:43:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:29.917916: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1734] Found device 3 with properties: 
pciBusID: 0000:63:00.0 name: Device 66a1     ROCm AMD GPU ISA: gfx906
coreClock: 1.7GHz coreCount: 64 deviceMemorySize: 15.98GiB deviceMemoryBandwidth: 953.67GiB/s
2021-04-20 13:52:29.917992: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library librocblas.so
2021-04-20 13:52:29.918038: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library libMIOpen.so
2021-04-20 13:52:29.918082: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library librocfft.so
2021-04-20 13:52:29.918125: I tensorflow/stream_executor/platform/default/dso_loader.cc:48] Successfully opened dynamic library librocrand.so
2021-04-20 13:52:29.918676: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1858] Adding visible gpu devices: 0, 1, 2, 3
2021-04-20 13:52:29.920415: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1257] Device interconnect StreamExecutor with strength 1 edge matrix:
2021-04-20 13:52:29.920463: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1263]      0 1 2 3 
2021-04-20 13:52:29.920498: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 0:   N Y Y Y 
2021-04-20 13:52:29.920530: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 1:   Y N Y Y 
2021-04-20 13:52:29.920564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 2:   Y Y N Y 
2021-04-20 13:52:29.920596: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1276] 3:   Y Y Y N 
2021-04-20 13:52:29.932072: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 15385 MB memory) -> physical GPU (device: 0, name: Device 66a1, pci bus id: 0000:04:00.0)
2021-04-20 13:52:29.939375: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:1 with 15385 MB memory) -> physical GPU (device: 1, name: Device 66a1, pci bus id: 0000:26:00.0)
2021-04-20 13:52:29.944123: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:2 with 15385 MB memory) -> physical GPU (device: 2, name: Device 66a1, pci bus id: 0000:43:00.0)
2021-04-20 13:52:29.948151: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1402] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:3 with 15385 MB memory) -> physical GPU (device: 3, name: Device 66a1, pci bus id: 0000:63:00.0)
I0420 13:52:29.980878 47739561595328 mirrored_strategy.py:341] Using MirroredStrategy with devices ('/job:localhost/replica:0/task:0/device:GPU:0', '/job:localhost/replica:0/task:0/device:GPU:1', '/job:localhost/replica:0/task:0/device:GPU:2', '/job:localhost/replica:0/task:0/device:GPU:3')
I0420 13:52:30.059932 47739561595328 run_squad_helper.py:236] Training using customized training loop with distribution strategy.
W0420 13:52:30.061461 47739561595328 device_compatibility_check.py:111] Mixed precision compatibility check (mixed_float16): WARNING
Your GPUs may run slowly with dtype policy mixed_float16 because they do not have compute capability of at least 7.0. Your GPUs:
  Device 66a1, no compute capability (probably not an Nvidia GPU) (x4)
See https://developer.nvidia.com/cuda-gpus for a list of GPUs and their compute capabilities.
If you will use compatible GPU(s) not attached to this host, e.g. by running a multi-worker model, you can ignore this warning. This message will only be logged once
W0420 13:52:30.061690 47739561595328 deprecation.py:323] From /public/home/xuanbaby/DL-TensorFlow/models_r2.3.0/official/nlp/bert/run_squad_helper.py:295: run_customized_training_loop (from official.nlp.bert.model_training_utils) is deprecated and will be removed in a future version.
Instructions for updating:
This function is deprecated. Please use Keras compile/fit instead.
I0420 13:52:30.061841 47739561595328 model_training_utils.py:228] steps_per_loop not specified. Using steps_per_loop=1
2021-04-20 13:52:31.177854: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.353766: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.362167: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.367682: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.373594: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.379299: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.385433: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.391268: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
2021-04-20 13:52:31.397368: I tensorflow/core/common_runtime/gpu_fusion_pass.cc:508] ROCm Fusion is enabled.
I0420 13:52:37.452952 47739561595328 optimization.py:89] using Adamw optimizer
I0420 13:52:37.461878 47739561595328 model_training_utils.py:273] Checkpoint file /public/home/xuanbaby/DL-TensorFlow/models_r2.3.0/official/nlp/bert/pre_tf2x/bert_model.ckpt found and restoring from initial checkpoint for core model.
I0420 13:52:43.295127 47739561595328 model_training_utils.py:276] Loading from checkpoint file completed
I0420 13:52:43.351998 47739561595328 model_training_utils.py:448] Checkpoint file /public/home/xuanbaby/DL-TensorFlow/models_r2.3.0/official/nlp/bert/model_squad/ctl_step_2100.ckpt-3 found and restoring from checkpoint
I0420 13:52:49.726183 47739561595328 model_training_utils.py:450] Loading from checkpoint file completed
I0420 13:52:52.106794 47739561595328 model_training_utils.py:49] Saving model as TF checkpoint: /public/home/xuanbaby/DL-TensorFlow/models_r2.3.0/official/nlp/bert/model_squad/ctl_step_2100.ckpt-4
PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU') memory growth: True
PhysicalDevice(name='/physical_device:GPU:1', device_type='GPU') memory growth: True
PhysicalDevice(name='/physical_device:GPU:2', device_type='GPU') memory growth: True
PhysicalDevice(name='/physical_device:GPU:3', device_type='GPU') memory growth: True
Traceback (most recent call last):
  File "run_squad_xuan.py", line 163, in <module>
    app.run(main)
  File "/public/home/xuanbaby/rocm3.9-python3.6.8-tf1.15/lib/python3.6/site-packages/absl/app.py", line 300, in run
    _run_main(main, args)
  File "/public/home/xuanbaby/rocm3.9-python3.6.8-tf1.15/lib/python3.6/site-packages/absl/app.py", line 251, in _run_main
    sys.exit(main(argv))
  File "run_squad_xuan.py", line 140, in main
    sub_model_export_name=FLAGS.sub_model_export_name,
  File "run_squad_xuan.py", line 60, in train_squad
    sub_model_export_name=sub_model_export_name)
  File "/public/home/xuanbaby/DL-TensorFlow/models_r2.3.0/official/nlp/bert/run_squad_helper.py", line 295, in train_squad
    post_allreduce_callbacks=[clip_by_global_norm_callback])
  File "/public/home/xuanbaby/rocm3.9-python3.6.8-tf1.15/lib/python3.6/site-packages/tensorflow/python/util/deprecation.py", line 324, in new_func
    return func(*args, **kwargs)
  File "/public/home/xuanbaby/DL-TensorFlow/models_r2.3.0/official/nlp/bert/model_training_utils.py", line 552, in run_customized_training_loop
    callback_list.on_epoch_end(int(current_step / steps_per_epoch), logs)
  File "/public/home/xuanbaby/rocm3.9-python3.6.8-tf1.15/lib/python3.6/site-packages/tensorflow/python/keras/callbacks.py", line 416, in on_epoch_end
    callback.on_epoch_end(epoch, numpy_logs)
  File "/public/home/xuanbaby/DL-TensorFlow/models_r2.3.0/official/utils/misc/keras_utils.py", line 146, in on_epoch_end
    epoch_run_time = time.time() - self.epoch_start
AttributeError: 'TimeHistory' object has no attribute 'epoch_start'
W0420 13:52:52.709877 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer.beta_1
W0420 13:52:52.710175 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer.beta_2
W0420 13:52:52.710281 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer.decay
W0420 13:52:52.710438 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-0.embeddings
W0420 13:52:52.710539 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-1.embeddings
W0420 13:52:52.710636 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-2.embeddings
W0420 13:52:52.710731 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-3.gamma
W0420 13:52:52.710827 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-3.beta
W0420 13:52:52.710921 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-1.layer_with_weights-0.kernel
W0420 13:52:52.711015 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-1.layer_with_weights-0.bias
W0420 13:52:52.711109 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_output_dense.kernel
W0420 13:52:52.711216 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_output_dense.bias
W0420 13:52:52.711309 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer_norm.gamma
W0420 13:52:52.711413 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer_norm.beta
W0420 13:52:52.711504 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._intermediate_dense.kernel
W0420 13:52:52.711600 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._intermediate_dense.bias
W0420 13:52:52.711693 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._output_dense.kernel
W0420 13:52:52.711787 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._output_dense.bias
W0420 13:52:52.711879 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._output_layer_norm.gamma
W0420 13:52:52.711973 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._output_layer_norm.beta
W0420 13:52:52.712068 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_output_dense.kernel
W0420 13:52:52.712161 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_output_dense.bias
W0420 13:52:52.712255 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer_norm.gamma
W0420 13:52:52.712365 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer_norm.beta
W0420 13:52:52.712460 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._intermediate_dense.kernel
W0420 13:52:52.712552 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._intermediate_dense.bias
W0420 13:52:52.712657 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._output_dense.kernel
W0420 13:52:52.712750 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._output_dense.bias
W0420 13:52:52.712842 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._output_layer_norm.gamma
W0420 13:52:52.712936 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._output_layer_norm.beta
W0420 13:52:52.713029 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_output_dense.kernel
W0420 13:52:52.713122 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_output_dense.bias
W0420 13:52:52.713215 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer_norm.gamma
W0420 13:52:52.713307 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer_norm.beta
W0420 13:52:52.713410 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._intermediate_dense.kernel
W0420 13:52:52.713502 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._intermediate_dense.bias
W0420 13:52:52.713597 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._output_dense.kernel
W0420 13:52:52.713688 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._output_dense.bias
W0420 13:52:52.713782 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._output_layer_norm.gamma
W0420 13:52:52.713875 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._output_layer_norm.beta
W0420 13:52:52.713967 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_output_dense.kernel
W0420 13:52:52.714061 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_output_dense.bias
W0420 13:52:52.714159 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer_norm.gamma
W0420 13:52:52.714252 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer_norm.beta
W0420 13:52:52.714363 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._intermediate_dense.kernel
W0420 13:52:52.714458 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._intermediate_dense.bias
W0420 13:52:52.714551 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._output_dense.kernel
W0420 13:52:52.714644 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._output_dense.bias
W0420 13:52:52.714739 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._output_layer_norm.gamma
W0420 13:52:52.714832 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._output_layer_norm.beta
W0420 13:52:52.714924 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_output_dense.kernel
W0420 13:52:52.715018 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_output_dense.bias
W0420 13:52:52.715110 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer_norm.gamma
W0420 13:52:52.715203 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer_norm.beta
W0420 13:52:52.715296 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._intermediate_dense.kernel
W0420 13:52:52.715399 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._intermediate_dense.bias
W0420 13:52:52.715491 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._output_dense.kernel
W0420 13:52:52.715584 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._output_dense.bias
W0420 13:52:52.715682 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._output_layer_norm.gamma
W0420 13:52:52.715775 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._output_layer_norm.beta
W0420 13:52:52.715867 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_output_dense.kernel
W0420 13:52:52.715959 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_output_dense.bias
W0420 13:52:52.716053 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer_norm.gamma
W0420 13:52:52.716145 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer_norm.beta
W0420 13:52:52.716246 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._intermediate_dense.kernel
W0420 13:52:52.716345 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._intermediate_dense.bias
W0420 13:52:52.716441 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._output_dense.kernel
W0420 13:52:52.716533 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._output_dense.bias
W0420 13:52:52.716628 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._output_layer_norm.gamma
W0420 13:52:52.716719 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._output_layer_norm.beta
W0420 13:52:52.716812 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_output_dense.kernel
W0420 13:52:52.716905 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_output_dense.bias
W0420 13:52:52.716997 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer_norm.gamma
W0420 13:52:52.717097 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer_norm.beta
W0420 13:52:52.717193 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._intermediate_dense.kernel
W0420 13:52:52.717286 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._intermediate_dense.bias
W0420 13:52:52.717389 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._output_dense.kernel
W0420 13:52:52.717484 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._output_dense.bias
W0420 13:52:52.717579 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._output_layer_norm.gamma
W0420 13:52:52.717672 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._output_layer_norm.beta
W0420 13:52:52.717765 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_output_dense.kernel
W0420 13:52:52.717857 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_output_dense.bias
W0420 13:52:52.717952 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer_norm.gamma
W0420 13:52:52.718047 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer_norm.beta
W0420 13:52:52.718142 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._intermediate_dense.kernel
W0420 13:52:52.718239 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._intermediate_dense.bias
W0420 13:52:52.718341 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._output_dense.kernel
W0420 13:52:52.718437 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._output_dense.bias
W0420 13:52:52.718532 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._output_layer_norm.gamma
W0420 13:52:52.718630 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._output_layer_norm.beta
W0420 13:52:52.718723 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_output_dense.kernel
W0420 13:52:52.718816 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_output_dense.bias
W0420 13:52:52.718909 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer_norm.gamma
W0420 13:52:52.719002 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer_norm.beta
W0420 13:52:52.719094 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._intermediate_dense.kernel
W0420 13:52:52.719187 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._intermediate_dense.bias
W0420 13:52:52.719280 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._output_dense.kernel
W0420 13:52:52.719387 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._output_dense.bias
W0420 13:52:52.719480 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._output_layer_norm.gamma
W0420 13:52:52.719575 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._output_layer_norm.beta
W0420 13:52:52.719668 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_output_dense.kernel
W0420 13:52:52.719762 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_output_dense.bias
W0420 13:52:52.719854 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer_norm.gamma
W0420 13:52:52.719947 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer_norm.beta
W0420 13:52:52.720040 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._intermediate_dense.kernel
W0420 13:52:52.720137 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._intermediate_dense.bias
W0420 13:52:52.720242 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._output_dense.kernel
W0420 13:52:52.720344 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._output_dense.bias
W0420 13:52:52.720438 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._output_layer_norm.gamma
W0420 13:52:52.720531 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._output_layer_norm.beta
W0420 13:52:52.720624 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_output_dense.kernel
W0420 13:52:52.720716 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_output_dense.bias
W0420 13:52:52.720809 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer_norm.gamma
W0420 13:52:52.720900 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer_norm.beta
W0420 13:52:52.720993 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._intermediate_dense.kernel
W0420 13:52:52.721086 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._intermediate_dense.bias
W0420 13:52:52.721179 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._output_dense.kernel
W0420 13:52:52.721270 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._output_dense.bias
W0420 13:52:52.721373 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._output_layer_norm.gamma
W0420 13:52:52.721466 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._output_layer_norm.beta
W0420 13:52:52.721570 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_output_dense.kernel
W0420 13:52:52.721662 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_output_dense.bias
W0420 13:52:52.721756 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer_norm.gamma
W0420 13:52:52.721848 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer_norm.beta
W0420 13:52:52.721940 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._intermediate_dense.kernel
W0420 13:52:52.722033 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._intermediate_dense.bias
W0420 13:52:52.722125 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._output_dense.kernel
W0420 13:52:52.722224 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._output_dense.bias
W0420 13:52:52.722317 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._output_layer_norm.gamma
W0420 13:52:52.722420 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._output_layer_norm.beta
W0420 13:52:52.722512 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._query_dense.kernel
W0420 13:52:52.722606 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._query_dense.bias
W0420 13:52:52.722702 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._key_dense.kernel
W0420 13:52:52.722795 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._key_dense.bias
W0420 13:52:52.722886 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._value_dense.kernel
W0420 13:52:52.722979 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._value_dense.bias
W0420 13:52:52.723079 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._query_dense.kernel
W0420 13:52:52.723172 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._query_dense.bias
W0420 13:52:52.723264 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._key_dense.kernel
W0420 13:52:52.723367 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._key_dense.bias
W0420 13:52:52.723463 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._value_dense.kernel
W0420 13:52:52.723556 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._value_dense.bias
W0420 13:52:52.723650 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._query_dense.kernel
W0420 13:52:52.723743 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._query_dense.bias
W0420 13:52:52.723836 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._key_dense.kernel
W0420 13:52:52.723927 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._key_dense.bias
W0420 13:52:52.724021 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._value_dense.kernel
W0420 13:52:52.724119 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._value_dense.bias
W0420 13:52:52.724213 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._query_dense.kernel
W0420 13:52:52.724306 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._query_dense.bias
W0420 13:52:52.724410 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._key_dense.kernel
W0420 13:52:52.724507 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._key_dense.bias
W0420 13:52:52.724599 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._value_dense.kernel
W0420 13:52:52.724693 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._value_dense.bias
W0420 13:52:52.724787 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._query_dense.kernel
W0420 13:52:52.724881 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._query_dense.bias
W0420 13:52:52.724973 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._key_dense.kernel
W0420 13:52:52.725067 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._key_dense.bias
W0420 13:52:52.725159 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._value_dense.kernel
W0420 13:52:52.725252 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._value_dense.bias
W0420 13:52:52.725353 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._query_dense.kernel
W0420 13:52:52.725448 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._query_dense.bias
W0420 13:52:52.725540 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._key_dense.kernel
W0420 13:52:52.725631 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._key_dense.bias
W0420 13:52:52.725724 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._value_dense.kernel
W0420 13:52:52.725817 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._value_dense.bias
W0420 13:52:52.725910 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._query_dense.kernel
W0420 13:52:52.726015 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._query_dense.bias
W0420 13:52:52.726109 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._key_dense.kernel
W0420 13:52:52.726202 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._key_dense.bias
W0420 13:52:52.726296 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._value_dense.kernel
W0420 13:52:52.726400 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._value_dense.bias
W0420 13:52:52.726494 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._query_dense.kernel
W0420 13:52:52.726587 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._query_dense.bias
W0420 13:52:52.726680 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._key_dense.kernel
W0420 13:52:52.726773 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._key_dense.bias
W0420 13:52:52.726867 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._value_dense.kernel
W0420 13:52:52.726958 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._value_dense.bias
W0420 13:52:52.727051 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._query_dense.kernel
W0420 13:52:52.727145 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._query_dense.bias
W0420 13:52:52.727238 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._key_dense.kernel
W0420 13:52:52.727343 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._key_dense.bias
W0420 13:52:52.727438 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._value_dense.kernel
W0420 13:52:52.727539 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._value_dense.bias
W0420 13:52:52.727633 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._query_dense.kernel
W0420 13:52:52.727727 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._query_dense.bias
W0420 13:52:52.727824 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._key_dense.kernel
W0420 13:52:52.727918 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._key_dense.bias
W0420 13:52:52.728011 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._value_dense.kernel
W0420 13:52:52.728106 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._value_dense.bias
W0420 13:52:52.728199 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._query_dense.kernel
W0420 13:52:52.728290 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._query_dense.bias
W0420 13:52:52.728394 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._key_dense.kernel
W0420 13:52:52.728487 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._key_dense.bias
W0420 13:52:52.728582 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._value_dense.kernel
W0420 13:52:52.728673 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._value_dense.bias
W0420 13:52:52.728765 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._query_dense.kernel
W0420 13:52:52.728858 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._query_dense.bias
W0420 13:52:52.728956 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._key_dense.kernel
W0420 13:52:52.729051 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._key_dense.bias
W0420 13:52:52.729143 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._value_dense.kernel
W0420 13:52:52.729238 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'm' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._value_dense.bias
W0420 13:52:52.729337 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-0.embeddings
W0420 13:52:52.729433 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-1.embeddings
W0420 13:52:52.729525 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-2.embeddings
W0420 13:52:52.729619 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-3.gamma
W0420 13:52:52.729710 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-3.beta
W0420 13:52:52.729810 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-1.layer_with_weights-0.kernel
W0420 13:52:52.729902 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-1.layer_with_weights-0.bias
W0420 13:52:52.729994 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_output_dense.kernel
W0420 13:52:52.730087 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_output_dense.bias
W0420 13:52:52.730180 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer_norm.gamma
W0420 13:52:52.730274 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer_norm.beta
W0420 13:52:52.730376 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._intermediate_dense.kernel
W0420 13:52:52.730477 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._intermediate_dense.bias
W0420 13:52:52.730569 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._output_dense.kernel
W0420 13:52:52.730663 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._output_dense.bias
W0420 13:52:52.730754 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._output_layer_norm.gamma
W0420 13:52:52.730848 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._output_layer_norm.beta
W0420 13:52:52.730940 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_output_dense.kernel
W0420 13:52:52.731033 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_output_dense.bias
W0420 13:52:52.731127 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer_norm.gamma
W0420 13:52:52.731219 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer_norm.beta
W0420 13:52:52.731313 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._intermediate_dense.kernel
W0420 13:52:52.731416 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._intermediate_dense.bias
W0420 13:52:52.731511 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._output_dense.kernel
W0420 13:52:52.731603 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._output_dense.bias
W0420 13:52:52.731696 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._output_layer_norm.gamma
W0420 13:52:52.731793 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._output_layer_norm.beta
W0420 13:52:52.731898 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_output_dense.kernel
W0420 13:52:52.731990 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_output_dense.bias
W0420 13:52:52.732084 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer_norm.gamma
W0420 13:52:52.732177 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer_norm.beta
W0420 13:52:52.732269 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._intermediate_dense.kernel
W0420 13:52:52.732374 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._intermediate_dense.bias
W0420 13:52:52.732470 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._output_dense.kernel
W0420 13:52:52.732565 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._output_dense.bias
W0420 13:52:52.732657 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._output_layer_norm.gamma
W0420 13:52:52.732754 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._output_layer_norm.beta
W0420 13:52:52.732851 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_output_dense.kernel
W0420 13:52:52.732944 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_output_dense.bias
W0420 13:52:52.733036 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer_norm.gamma
W0420 13:52:52.733129 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer_norm.beta
W0420 13:52:52.733221 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._intermediate_dense.kernel
W0420 13:52:52.733313 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._intermediate_dense.bias
W0420 13:52:52.733420 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._output_dense.kernel
W0420 13:52:52.733515 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._output_dense.bias
W0420 13:52:52.733608 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._output_layer_norm.gamma
W0420 13:52:52.733706 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._output_layer_norm.beta
W0420 13:52:52.733800 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_output_dense.kernel
W0420 13:52:52.733891 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_output_dense.bias
W0420 13:52:52.733984 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer_norm.gamma
W0420 13:52:52.734077 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer_norm.beta
W0420 13:52:52.734171 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._intermediate_dense.kernel
W0420 13:52:52.734263 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._intermediate_dense.bias
W0420 13:52:52.734365 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._output_dense.kernel
W0420 13:52:52.734460 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._output_dense.bias
W0420 13:52:52.734555 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._output_layer_norm.gamma
W0420 13:52:52.734646 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._output_layer_norm.beta
W0420 13:52:52.734740 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_output_dense.kernel
W0420 13:52:52.734832 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_output_dense.bias
W0420 13:52:52.734933 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer_norm.gamma
W0420 13:52:52.735028 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer_norm.beta
W0420 13:52:52.735119 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._intermediate_dense.kernel
W0420 13:52:52.735213 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._intermediate_dense.bias
W0420 13:52:52.735305 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._output_dense.kernel
W0420 13:52:52.735408 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._output_dense.bias
W0420 13:52:52.735501 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._output_layer_norm.gamma
W0420 13:52:52.735594 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._output_layer_norm.beta
W0420 13:52:52.735693 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_output_dense.kernel
W0420 13:52:52.735786 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_output_dense.bias
W0420 13:52:52.735878 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer_norm.gamma
W0420 13:52:52.735969 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer_norm.beta
W0420 13:52:52.736063 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._intermediate_dense.kernel
W0420 13:52:52.736155 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._intermediate_dense.bias
W0420 13:52:52.736248 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._output_dense.kernel
W0420 13:52:52.736353 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._output_dense.bias
W0420 13:52:52.736449 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._output_layer_norm.gamma
W0420 13:52:52.736541 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._output_layer_norm.beta
W0420 13:52:52.736634 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_output_dense.kernel
W0420 13:52:52.736726 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_output_dense.bias
W0420 13:52:52.736820 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer_norm.gamma
W0420 13:52:52.736912 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer_norm.beta
W0420 13:52:52.737005 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._intermediate_dense.kernel
W0420 13:52:52.737098 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._intermediate_dense.bias
W0420 13:52:52.737189 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._output_dense.kernel
W0420 13:52:52.737283 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._output_dense.bias
W0420 13:52:52.737388 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._output_layer_norm.gamma
W0420 13:52:52.737483 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._output_layer_norm.beta
W0420 13:52:52.737575 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_output_dense.kernel
W0420 13:52:52.737677 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_output_dense.bias
W0420 13:52:52.737770 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer_norm.gamma
W0420 13:52:52.737869 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer_norm.beta
W0420 13:52:52.737961 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._intermediate_dense.kernel
W0420 13:52:52.738054 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._intermediate_dense.bias
W0420 13:52:52.738152 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._output_dense.kernel
W0420 13:52:52.738244 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._output_dense.bias
W0420 13:52:52.738345 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._output_layer_norm.gamma
W0420 13:52:52.738439 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._output_layer_norm.beta
W0420 13:52:52.738533 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_output_dense.kernel
W0420 13:52:52.738626 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_output_dense.bias
W0420 13:52:52.738719 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer_norm.gamma
W0420 13:52:52.738811 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer_norm.beta
W0420 13:52:52.738904 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._intermediate_dense.kernel
W0420 13:52:52.738998 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._intermediate_dense.bias
W0420 13:52:52.739090 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._output_dense.kernel
W0420 13:52:52.739183 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._output_dense.bias
W0420 13:52:52.739274 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._output_layer_norm.gamma
W0420 13:52:52.739382 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._output_layer_norm.beta
W0420 13:52:52.739475 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_output_dense.kernel
W0420 13:52:52.739569 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_output_dense.bias
W0420 13:52:52.739670 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer_norm.gamma
W0420 13:52:52.739765 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer_norm.beta
W0420 13:52:52.739858 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._intermediate_dense.kernel
W0420 13:52:52.739952 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._intermediate_dense.bias
W0420 13:52:52.740044 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._output_dense.kernel
W0420 13:52:52.740138 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._output_dense.bias
W0420 13:52:52.740232 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._output_layer_norm.gamma
W0420 13:52:52.740325 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._output_layer_norm.beta
W0420 13:52:52.740429 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_output_dense.kernel
W0420 13:52:52.740523 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_output_dense.bias
W0420 13:52:52.740616 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer_norm.gamma
W0420 13:52:52.740709 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer_norm.beta
W0420 13:52:52.740808 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._intermediate_dense.kernel
W0420 13:52:52.740900 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._intermediate_dense.bias
W0420 13:52:52.740994 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._output_dense.kernel
W0420 13:52:52.741086 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._output_dense.bias
W0420 13:52:52.741180 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._output_layer_norm.gamma
W0420 13:52:52.741272 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._output_layer_norm.beta
W0420 13:52:52.741376 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._query_dense.kernel
W0420 13:52:52.741470 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._query_dense.bias
W0420 13:52:52.741570 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._key_dense.kernel
W0420 13:52:52.741663 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._key_dense.bias
W0420 13:52:52.741757 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._value_dense.kernel
W0420 13:52:52.741851 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-4._attention_layer._value_dense.bias
W0420 13:52:52.741944 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._query_dense.kernel
W0420 13:52:52.742038 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._query_dense.bias
W0420 13:52:52.742130 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._key_dense.kernel
W0420 13:52:52.742225 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._key_dense.bias
W0420 13:52:52.742328 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._value_dense.kernel
W0420 13:52:52.742469 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-5._attention_layer._value_dense.bias
W0420 13:52:52.742562 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._query_dense.kernel
W0420 13:52:52.742656 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._query_dense.bias
W0420 13:52:52.742750 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._key_dense.kernel
W0420 13:52:52.742849 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._key_dense.bias
W0420 13:52:52.742942 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._value_dense.kernel
W0420 13:52:52.743038 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-6._attention_layer._value_dense.bias
W0420 13:52:52.743132 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._query_dense.kernel
W0420 13:52:52.743224 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._query_dense.bias
W0420 13:52:52.743319 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._key_dense.kernel
W0420 13:52:52.743422 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._key_dense.bias
W0420 13:52:52.743521 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._value_dense.kernel
W0420 13:52:52.743614 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-7._attention_layer._value_dense.bias
W0420 13:52:52.743708 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._query_dense.kernel
W0420 13:52:52.743805 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._query_dense.bias
W0420 13:52:52.743901 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._key_dense.kernel
W0420 13:52:52.743995 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._key_dense.bias
W0420 13:52:52.744090 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._value_dense.kernel
W0420 13:52:52.744182 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-8._attention_layer._value_dense.bias
W0420 13:52:52.744275 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._query_dense.kernel
W0420 13:52:52.744378 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._query_dense.bias
W0420 13:52:52.744474 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._key_dense.kernel
W0420 13:52:52.744567 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._key_dense.bias
W0420 13:52:52.744659 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._value_dense.kernel
W0420 13:52:52.744753 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-9._attention_layer._value_dense.bias
W0420 13:52:52.744845 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._query_dense.kernel
W0420 13:52:52.744941 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._query_dense.bias
W0420 13:52:52.745035 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._key_dense.kernel
W0420 13:52:52.745130 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._key_dense.bias
W0420 13:52:52.745221 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._value_dense.kernel
W0420 13:52:52.745319 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-10._attention_layer._value_dense.bias
W0420 13:52:52.745426 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._query_dense.kernel
W0420 13:52:52.745520 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._query_dense.bias
W0420 13:52:52.745615 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._key_dense.kernel
W0420 13:52:52.745707 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._key_dense.bias
W0420 13:52:52.745802 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._value_dense.kernel
W0420 13:52:52.745896 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-11._attention_layer._value_dense.bias
W0420 13:52:52.745989 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._query_dense.kernel
W0420 13:52:52.746080 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._query_dense.bias
W0420 13:52:52.746174 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._key_dense.kernel
W0420 13:52:52.746266 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._key_dense.bias
W0420 13:52:52.746369 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._value_dense.kernel
W0420 13:52:52.746463 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-12._attention_layer._value_dense.bias
W0420 13:52:52.746556 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._query_dense.kernel
W0420 13:52:52.746648 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._query_dense.bias
W0420 13:52:52.746741 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._key_dense.kernel
W0420 13:52:52.746839 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._key_dense.bias
W0420 13:52:52.746932 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._value_dense.kernel
W0420 13:52:52.747025 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-13._attention_layer._value_dense.bias
W0420 13:52:52.747119 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._query_dense.kernel
W0420 13:52:52.747211 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._query_dense.bias
W0420 13:52:52.747310 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._key_dense.kernel
W0420 13:52:52.747417 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._key_dense.bias
W0420 13:52:52.747510 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._value_dense.kernel
W0420 13:52:52.747605 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-14._attention_layer._value_dense.bias
W0420 13:52:52.747700 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._query_dense.kernel
W0420 13:52:52.747795 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._query_dense.bias
W0420 13:52:52.747888 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._key_dense.kernel
W0420 13:52:52.747983 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._key_dense.bias
W0420 13:52:52.748075 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._value_dense.kernel
W0420 13:52:52.748171 47739561595328 util.py:150] Unresolved object in checkpoint: (root).optimizer's state 'v' for (root).model.layer_with_weights-0.layer_with_weights-15._attention_layer._value_dense.bias
W0420 13:52:52.748269 47739561595328 util.py:158] A checkpoint was restored (e.g. tf.train.Checkpoint.restore or tf.keras.Model.load_weights) but not all checkpointed values were used. See above for specific issues. Use expect_partial() on the load status object, e.g. tf.train.Checkpoint.restore(...).expect_partial(), to silence these warnings, or use assert_consumed() to make the check explicit. See https://www.tensorflow.org/guide/checkpoint#loading_mechanics for details.