TLDR AI · HEADLINES & LAUNCHES

GPT-3.5-TURBO IS 20B PARAMETER

arxiv.org2 min read

Summary from the TLDR AI newsletter

Researchers wrote that gpt-3.5-turbo (the model behind ChatGPT) is a 20B parameter model in a paper by a Microsoft research group that studies diffusion models for code. The original model was said to be 175B parameters, so there could have been retraining or distillation.