1090 Source Code

80% Code
20% Language

Code Data Recipe [Stackcoder]

1) Order by Repo ✓
2) Call Heuristic Filters ❌
3) Group by Repo, lang ⟷ minhash ✓
4) Pack into Repo-level docs △
5) Select PL's △

6) Pack into FIM tokens ✗

✓: Eng Done
✗: Eng definitely NOT done
△: so so easy

Use Preprocessed code text, web text

*not critical