NVIDIA VERA'S MEMORY SYSTEM DELIVERS 1.2 TB/S WITH FLAT LATENCY, BUT CROSS-SOCKET LINKS LAG

Summary from the TLDR Hardware newsletter

Chips and Cheese's teardown of Vera's fabric found a 1024-bit LPDDR5X-9600 interface delivering 1.228 TB/s, with latency staying under 200 ns even as bandwidth load climbs, plus a 164 MB shared L3 and field-serviceable SOCAMM2 modules. NVLink C2C moves up to 780 GB/s between sockets, but cross-socket core-to-core latency is around 660 ns. Vera trails Graviton 5 on socket-level throughput but leads by nearly 20% in DRAM-bound SPEC tests.