ConceptHBM / High Bandwidth Memory / HBM3
High Bandwidth Memory
A memory solution that vertically stacks multiple DRAM dies using through-silicon vias and places them in close proximity to the processor via 2.5D packaging. Its very wide physical bus provides memory bandwidth far exceeding GDDR at relatively low operating frequencies, and it is widely used in AI accelerators.
Timeline (last 90 days)
Oct 20
For local inference scenarios, high-bandwidth memory (such as Apple's unified memory architecture, or the HBM of high-end GPUs) is more important than multi-core CPUs.
Unverified50%