Digital Design & Computer Architecture - Lecture 23: Memory Hierarchy and Caches (Spring 2022)

Onur Mutlu Lectures
Onur Mutlu LecturesFeb 16, 2026

Why It Matters

These technology trade-offs directly shape processor architecture, system performance, and storage design; emerging nonvolatile memories could upend conventional memory hierarchies and enable new system-level optimizations. Understanding the limits of each memory type is essential for architects and businesses planning for future compute and storage products.

Summary

The lecture reviewed fundamentals of memory organization and the design of memory hierarchies and caches, emphasizing why SRAM is used for on-chip caches while DRAM serves as main memory due to differing fabrication and capacitor requirements. It surveyed memory technologies — DRAM, SRAM, flash, phase-change (PCM) and emerging resistive memories — highlighting trade-offs such as latency versus density, non-volatility, and endurance constraints. The instructor noted how technologies like flash and PCM can disrupt traditional hierarchies by blurring the line between working memory and storage, and described the complexity of flash-based storage controllers and their internal memory hierarchies. Practical manufacturing and system-design considerations were stressed as key reasons for current architectural choices and potential future shifts.

Original Description

Digital Design and Computer Architecture, ETH Zürich, Spring 2022 (https://safari.ethz.ch/digitaltechnik/spring2022/)
Lecture 23: Memory Hierarchy and Caches
Lecturer: Professor Onur Mutlu (https://people.inf.ethz.ch/omutlu/)
Date: May 20, 2022
Recommended Reading:
====================
A Modern Primer on Processing in Memory
Intelligent Architectures for Intelligent Computing Systems
RowHammer: A Retrospective
Fundamentally Understanding and Solving RowHammer
RECOMMENDED LECTURE VIDEOS & PLAYLISTS:
========================================
Computer Architecture Fall 2021 Lectures Playlist:
Digital Design and Computer Architecture Spring 2021 Livestream Lectures Playlist:
Featured Lectures:
Interview with Professor Onur Mutlu:
The Story of RowHammer Lecture:
Accelerating Genome Analysis Lecture:
Memory-Centric Computing Systems Tutorial at IEDM 2021:
Intelligent Architectures for Intelligent Machines Lecture:
Computer Architecture Fall 2020 Lectures Playlist:
Digital Design and Computer Architecture Spring 2020 Lectures Playlist:
Public Lectures by Onur Mutlu, Playlist:
Computer Architecture at Carnegie Mellon Spring 2015 Lectures Playlist:
Rethinking Memory System Design Lecture @stanfordonline :

Comments

Want to join the conversation?

Loading comments...