TLDR Web Dev · MISCELLANEOUS

LLMS KNOW MORE THAN WHAT THEY SAY

arjunbansal.substack.com11 min read

Summary from the TLDR Web Dev newsletter

An approach called Latent Space Readout (LSR) can improve the accuracy of AI application evals. LSR uses interpretability research by projecting evaluation model activations onto meaningful linear directions, which makes it more sample efficient than fine-tuning. This means that much less human feedback is required for these evals to be more accurate.