DWARFSTAR

Summary from the TLDR DevOps newsletter

DwarfStar is a native inference engine built specifically for running DeepSeek V4 Flash and DeepSeek V4 PRO locally, with additional support for GLM 5.2. It is not a general GGUF runner. The project includes model loading, prompt rendering, tool calls, KV state, an HTTP server, and a coding agent built and tested together. It supports Metal on macOS, CUDA, and ROCm backends, and can split large models across multiple machines using pipeline or tensor parallelism over Thunderbolt or TCP.