TLDR AI · MISCELLANEOUS

WHY DIFFUSION COULD HELP LLMS REASON

links.tldrnewsletter.com26 min read

Summary from the TLDR AI newsletter

Current language models predict one word at a time, which gives very little room for planning and reasoning. There are ways around this such as Chain of Thought prompting. However, potentially using diffusion models, which can spend more diffusion steps per token, could be a way to improve model reasoning.