TLDR AI · HEADLINES & LAUNCHES
GPT-3.5-TURBO IS 20B PARAMETER
Summary from the TLDR AI newsletter
Researchers wrote that gpt-3.5-turbo (the model behind ChatGPT) is a 20B parameter model in a paper by a Microsoft research group that studies diffusion models for code. The original model was said to be 175B parameters, so there could have been retraining or distillation.