Unverified Commit 5d178954 authored by Joe Davison's avatar Joe Davison Committed by GitHub
Browse files

tiny ppl doc typo fix (#5751)

parent ac921f03
...@@ -123,7 +123,7 @@ are 512 preceding tokens available to condition on). ...@@ -123,7 +123,7 @@ are 512 preceding tokens available to condition on).
stride = 512 stride = 512
lls = [] lls = []
for i in tqdm(range(1, encodings.input_ids.size(1), stride)): for i in tqdm(range(0, encodings.input_ids.size(1), stride)):
begin_loc = max(i + stride - max_length, 0) begin_loc = max(i + stride - max_length, 0)
end_loc = i + stride end_loc = i + stride
input_ids = encodings.input_ids[:,begin_loc:end_loc].to(device) input_ids = encodings.input_ids[:,begin_loc:end_loc].to(device)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment