PAC-PLRU: A cache replacement policy to salvage discarded predictions from hardware prefetchers

Ke Zhang, Zhensong Wang, Yong Chen, Huaiyu Zhu, Xian He Sun

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations

Abstract

Cache replacement policy plays an important role in guaranteeing the availability of cache blocks, reducing miss rates, and improving applications' overall performance. However, recent research efforts on improving replacement policies require either significant additional hardware or major modifications to the organization of the existing cache. In this study, we propose the PAC-PLRU cache replacement policy. PAC-PLRU not only utilizes but also judiciously salvages the prediction information discarded from a widely-adopted stride prefetcher. The main idea behind PAC-PLRU is utilizing the prediction results generated by the existing stride prefetcher and preventing these predicted cache blocks from being replaced in the near future. Experimental results show that leveraging the PAC-PLRU with a stride prefetcher reduces the average L2 cache miss rate by 91 over a baseline system with only PLRU policy, and by 22 over a system using PLRU with an unconnected stride prefetcher. Most importantly, PAC-PLRU only requires minor modifications to existing cache architecture to get these benefits. The proposed PAC-PLRU policy is promising in fostering the connection between prefetching and replacement policies, and have a lasting impact on improving the overall cache performance.

Original languageEnglish
Title of host publicationProceedings - 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011
Pages265-274
Number of pages10
DOIs
StatePublished - 2011
Event11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011 - Newport Beach, CA, United States
Duration: May 23 2011May 26 2011

Publication series

NameProceedings - 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011

Conference

Conference11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, CCGrid 2011
CountryUnited States
CityNewport Beach, CA
Period05/23/1105/26/11

Keywords

  • cache replacement policy
  • computer architecture
  • high-performance processors
  • memory wall

Fingerprint Dive into the research topics of 'PAC-PLRU: A cache replacement policy to salvage discarded predictions from hardware prefetchers'. Together they form a unique fingerprint.

Cite this