Improving Key-Value Cache Performance With Heterogeneous Memory Tiering: A Case Study of Compute-Express-Link-Based Memory Expansion
Sign Up to like & getrecommendations! Published in 2025 at "IEEE Micro"
DOI: 10.1109/mm.2024.3358861
Abstract: Compute Express Link (CXL) memory brings extra bandwidth and capacity via Peripheral-Component-Interconnect-Express-based memory expansion beyond double-data-rate-based dynamic random-access memory. This article introduces the CXL 2.0 memory expansion solution, which incorporates two parts: 1) a CXL… read more here.
Keywords: memory expansion; memory; cxl memory; express ... See more keywords
Compute-Enabled CXL Memory Expansion for Efficient Retrieval Augmented Generation
Sign Up to like & getrecommendations! Published in 2025 at "IEEE Micro"
DOI: 10.1109/mm.2025.3575280
Abstract: Conventional processing near-memory architectures often strike a tradeoff between memory capacity and memory bandwidth, leading to high initial data movement or high capital costs due to memory stranding. In this work, we introduce compute-enabled memory… read more here.
Keywords: memory expansion; retrieval; memory; retrieval augmented ... See more keywords