META RELEASES ‘CODE LLAMA 70B’, AN OPEN-SOURCE BEHEMOTH TO RIVAL PRIVATE AI DEVELOPMENT

Summary from the TLDR newsletter

Code Llama 70B, one of the largest open-source AI models for code generation currently available, was trained on 500 billion tokens of code and code-related data and has a context window of 100,000 tokens.