Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
gpt3s-hf.yaml 232 Bytes
Newer Older
Tri Dao's avatar
Update configs, add results  
Tri Dao committed
1
2
3
4
5
6
7
8
9
10
11
12 
# @package _global_
defaults:
  - /experiment/pile/base.yaml
  - override /model: gpt2-hf
  - override /model/gpt2model: gpt2-small

datamodule:
  batch_size: 8

train:
  # Use the standard torch.nn.CrossEntropyLoss
  loss_fn: null