HBM (High Bandwidth Memory)

Also: high bandwidth memory · hbm3e

HBM is the fast memory stacked on the same package as an AI accelerator (e.g., HBM3e). Its capacity caps the model size a chip can hold, its bandwidth caps decode throughput (via MBU), and it is one of the single largest line items in a rack’s bill of materials.

← All terms · Definitions maintained by Mintok. Methodology.