COST OF SELF-HOSTING LLAMA-3 8B-INSTRUCT

Summary from the TLDR AI newsletter

Self-hosting an LLM like Llama-3 8B-Instruct can be significantly more expensive than using ChatGPT, costing around $17 per million tokens compared to ChatGPT's $1 per million tokens. The cost of self-hosted hardware can be reduced to less than $0.01 per million tokens, though it would take approximately 5.5 years to break even on the initial investment.