P1: 100% Source code
P2: 80% code
20% language

Code Data Recipe [Stacoder]

1) Order by Repo ✓
2) Call Heuristic Filters ✗
3) Group by Repo, lang → minhash ✓
4) Pack into Repo-level docs Ø
5) Select PL's Ø

Go) Pack into FIM tokens ✗

✓: Eng. Done
✗: Eng. Definitely NOT done
Ø: So so easy

Use Preprocessed code/text, webtext