Daily Edition · Page 2

THE DAILY INDEX

Technology, AI, software, security, crypto and business

MISCELLANEOUS

TLDR

GROQ IS SERVING THE FASTEST RESPONSES I'VE EVER SEEN

Groq can serve up to 500 tokens per second. It is able to do this because it uses custom hardware that utilizes Linear Processor Units (LPUs) instead of GPUs. LPUs are designed to deliver deterministic performance for AI computations. They offer a more streamlined approach that eliminates the need for complex scheduling hardware, allowing every clock cycle to be utilized effectively. The system ensures consistent latency and throughput. LPUs can be linked together without the traditional bottlenecks found in GPU clusters, making them extremely scalable.

I PRINTED CHOCOLATE ON A 3D PRINTER AND ATE IT

The Cocoa Press is a 3D printer that prints chocolate. It is now available for $3,995 prebuilt after a decade of development. Premade chocolate cores cost $49 per pack of 10. The printer allows users to program the heat of its nozzle to a tenth of a degree. It can create a wide range of shapes and textures, but there are still some problems to work out. This article shares what it is like using the machine. Pictures of chocolate prints made by the machine are available.

TLDR IndexPage 2