DEEPEVAL

Summary from the TLDR newsletter

DeepEval is an open source framework for evaluating and testing large language model systems. It incorporates the latest research to evaluate model outputs using locally run models. DeepEval supports applications implemented via RAG, fine-tuning, LangChain, LlamaIndex, and more. It helps developers easily determine the optimal hyperparameters to improve their RAG pipeline, improve prompt drifting, or transition from OpenAI to hosting their own Llama 3.