"LOCAL MODEL SUPPORT" DOESN'T MEAN WHAT YOU THINK IT MEANS

Summary from the TLDR AI newsletter

Every AI gateway lists self-hosted models as a supported provider, but what does that actually require of you? ngrok's Sam Rose wired one fine-tuned Llama into 7 popular AI gateways and documented what each one really needs to reach it. E.g., "just give us an OpenAI-compatible base URL" = your GPU box needs a public hostname and an open inbound port. See what each gateway actually requires and give ngrok.ai a