Mobile version of Hanspub
Proceedings of the 41st Annual IEEE/ACM International Symposium on Microarchitecture, IEEE Computer Society

Coordinated Man-agement of Multiple Interacting Resources in Chip Multiprocessors: A Machine Learning Approach

Bitirgen R. Ipek E. and Martinez J.F.

learning (artificial intelligence)microprocessor chipschip multiprocessorscoordinated managementglobal resource allocationmachine learningmicroarchitectural resourcemultiple interacting resourcesopen problemresource management scheme

Efficient sharing of system resources is critical to obtaining high utilization and enforcing system-level performance objectives on chip multiprocessors (CMPs). Although several proposals that address the management of a single microarchitectural resource have been published in the literature, coordinated management of multiple interacting resources on CMPs remains an open problem. We propose a framework that manages multiple shared CMP resources in a coordinated fashion to enforce higher-level performance objectives. We formulate global resource allocation as a machine learning problem. At runtime, our resource management scheme monitors the execution of each application, and learns a predictive model of system performance as a function of allocation decisions. By learning each application's performance response to different resource distributions, our approach makes it possible to anticipate the system-level performance impact of allocation decisions at runtime with little runtime overhead. As a result, it becomes possible to make reliable comparisons among different points in a vast and dynamically changing allocation space, allowing us to adapt our allocation decisions as applications undergo phase changes. Our evaluation concludes that a coordinated approach to managing multiple interacting resources is key to delivering high performance in multiprogrammed workloads, but this is possible only if accompanied by efficient search mechanisms. We also show that it is possible to build a single mechanism that consistently delivers high performance under various important performance metrics.