MICROSOFT LASERS AWAY LLM INACCURACIES

Summary from the TLDR newsletter

Layer-Selective Rank Reduction (LASER) is a technique that involves replacing one weight matrix with an approximate smaller one, making it so the model relies less on it - the technique makes large language models more accurate.