CREATING A BESPOKE LLM FOR AI-LARGENERATED DOCUMENTATION

Summary from the TLDR Web Dev newsletter

Databricks recently announced an AI-generated documentation feature, using large language models (LLMs) to automate documentation for tables and columns, with over 80% of the company’s table metadata updates now AI-assisted. A bespoke LLM was developed by two Databricks engineers in one month for under $1,000 in compute costs, resulting in high quality, fast throughput, and low costs. This new model, MPT-7B, fine-tuned on around 3,600 examples, addresses issues of documentation in data platforms and demonstrates the feasibility and efficiency of creating custom LLMs for specific tasks.