WHICH TABLE FORMAT DO LLMS UNDERSTAND BEST? (RESULTS FOR 11 FORMATS)

Summary from the TLDR AI newsletter

Understanding format sensitivity in large language models is crucial for data pipeline architecture, performance optimization, and cost management. Many RAG pipelines involve ingesting documents that contain tables of data. These tables need to be formatted in a way that is easy for models to consume otherwise they may be needlessly hurting the accuracy of the overall system. Markdown-KV appears to be a good default to use in situations where accuracy is paramount. CSV and JSONL can hurt system accuracy.