JEDEC developing reduced pin count HBM4 standard to enable higher capacity

Summary

The JEDEC Solid State Technology Association is developing a way to increase overall high bandwidth memory (HBM) capacity with longer channel distances to enable more HBM stacks per GPU. JEDEC is the Joint Electron Device Engineering Council. Standard Package High Bandwidth Memory (SPHBM4) is similar to an HBM4 device with its silicon substrate, but with fewer pins in the different base interface die design, which can be mounted on standard organic substrates. Mian Quddus Mian Quddus, chairman of the JEDEC Board of Directors, said: “JEDEC members are actively shaping the standards that will define next generation modules for use in AI data centers, driving the future of innovation in infrastructure and performance.” HBM3 has 1024 pins. An HBM4 device has 2,048 pins, through which digital signals pass, doubling its performance. The planned SPHBM4 device has a quarter of this number, 512, and operates at a higher frequency, with 4:1 serialization, so that it supplies the same aggregate throughput as HBM4. It means one SPHBM4 pin can do the same amount of work as four HBM4 pins in bandwidth terms. Because there are fewer pins, they can be set wider apart. JEDEC says this change allows the relaxed bump pitch required for connection to organic substrates. Silicon substrates support a high interconnect density, with lines having a more than 10 μm pitch, whereas organic substrates have a less than 20 μm pitch. They also cost less. HBM4 and SPHBM4 devices are expected to have the same memory capacity. Organic substrate-mounted devices can be further away (have a longer channel length) from HBM4 devices. This potentially increases the number of permissible SPHBM4 stacks and so increases overall memory capacity over HBM4. SPHBM4 memory stacks, with a 4:1 pin count reduction, will need a redesigned base logic die. Eliyan, a base logic die semiconductor company, posted a LinkedIn comment about SPHBM4: “Our #NuLink D2D/D2M #interconnect solution has demonstrated the ability to a...