HOW DOES CHATGPT WORK? AS EXPLAINED BY THE CHATGPT TEAM

Summary from the TLDR Web Dev newsletter

ChatGPT works by predicting the next most likely word. After ChatGPT receives text, it breaks down the text into tokens. These tokens are converted into numerical vectors that represent their meaning and relationships to other words. The vectors, called embeddings, are multiplied by a massive matrix of weights (parameters) that have been learned during the training process. The result of the multiplication is a probability distribution over possible next words. ChatGPT samples a word from this distribution to continue the text.