DEEPSEEK OPEN SOURCES DSPARK, A NEW FRAMEWORK TO SPEED UP LLM INFERENCE BY UP TO 85%

Summary from the TLDR AI newsletter

DSpark is a system designed to make large language models answer faster without changing what the underlying model is trying to say. Most AI models write one small chunk of text at a time. DSpark acts as a scout that runs a few steps ahead, guesses the likely path, and lets the larger model quickly check which steps are safe. When guesses are good, the model moves faster, but if they are weak, DSpark tries not to waste time checking them.