V-February Flow
Data Components
Code:
The-Stack-V2
CodeText:
SE, whatever we've scraped
WebText:
HQ OCLM
DATA MIXES
~85% Source code ] Deepseek
~10% CodeText Coder
~5% Webtext
~85% The-stack-V2 ] Starcoder
~15% CodeText 2
~ 0% webtext
~100% Source code ] Arctic
