MRDIMM, short for Multi-Ranked buffered DIMM, is a new memory technology that promises to revolutionize the world of servers with its high-capacity and high-bandwidth capabilities. Developed by AMD and JEDEC, this technology aims to provide a more efficient way of handling AI workloads in servers.
Unlike traditional unregistered RAM sticks commonly used in gaming PCs, MRDIMM utilizes multiple ranks of DRAM to increase memory bandwidth. By using a buffered DIMM design, MRDIMM is able to achieve speeds of up to 8,800 MT/s with capacities of up to 256 GB. This technology improves reliability and performance in servers, making it a valuable asset in the data center industry.
While there are other ways to enhance memory bandwidth, such as stacking DRAM chips using Through-Silicon-Vias (TSVs) like in High Bandwidth Memory (HBM), MRDIMM offers a more cost-effective solution. By modifying the hardware register to support multiple ranks of DRAM, MRDIMM is able to double the effective bandwidth without the added expense of TSV technology.
The development of MRDIMM memory has been a collaborative effort between industry giants like Intel, SK Hynix, and Renesas. In 2022, Intel started working on MCR DIMMs for its servers, while in 2023, AMD and JEDEC began work on the DDR5 MRDIMM standard. With Micron now introducing MRDIMM into the market, we can expect to see widespread adoption of this technology in the near future.
While currently targeted at Intel Xeon 6 server processors, MRDIMM is expected to become an open standard that will eventually be compatible with AMD’s Epyc servers as well. The introduction of multi-rank DIMMs may raise concerns about compatibility with existing hardware, but the benefits of increased memory bandwidth and capacity far outweigh any potential drawbacks.
MRDIMM memory technology represents a significant advancement in the field of server memory. With its high-capacity, high-bandwidth design, MRDIMM promises to revolutionize the way data centers handle AI workloads. While there may be some initial challenges in adoption, the long-term benefits of this technology are undeniable. As the industry continues to evolve, MRDIMM will play a crucial role in shaping the future of server memory architecture.
Leave a Reply