TEACHING AN LLM A NICHE DIAGRAMING LANGUAGE

Summary from the TLDR Dev newsletter

A 7B language model (Qwen2.5-Coder-7B) was successfully trained (with 86% accuracy) to generate and edit diagrams using the less popular Pintora language. The training involved continued pretraining on Pintora diagrams, followed by instruction fine-tuning. Data was generated by an AI agent, cleaned, and used to train the model with limited resources on Google Colab and Runpod.