Hardware support for OpenMP collective operations

Soohong P. Kim, Samuel P. Midkiff, Henry G. Dietz

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


Efficient implementation of OpenMP collective operations (e.g. barriers and reductions) is essential for good performance from OpenMP programs. State-of-the-art on-chip networks and block-based cache coherence protocols used in shared memory Chip MultiProcessors (CMPs) are inefficient for implementing these collective operations. The performance of CMPs can be seriously degraded by the multitude of memory requests and coherence messages required to implement collective operations. To provide efficient support for OpenMP collective operations, this paper presents a CMP-AFN architecture and Instruction Set Architecture (ISA) extensions that augment a conventional shared-memory CMP with a tightly-integrated Aggregate Function Network (AFN) that implements low-latency collectives without using or interfering with the memory hierarchy. For a modest increase in circuit complexity, traffic within a CMP's internal network is dramatically reduced, improving the performance of caches and reducing power consumption. Full system simulations of 16-core CMPs show a CMP-AFN outperforms the reference design significantly, eliminating more than 60% of memory accesses and more than 70% of private L1 data cache misses in both the EPCC OpenMP microbenchmarks and SPEC OMP benchmarks.

Original languageEnglish
Title of host publicationLanguages and Compilers for Parallel Computing - 22nd International Workshop, LCPC 2009, Revised Selected Papers
Number of pages19
StatePublished - 2010
Event22nd International Workshop on Languages and Compilers for Parallel Computing, LCPC 2009 - Newark, DE, United States
Duration: Oct 8 2009Oct 10 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5898 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference22nd International Workshop on Languages and Compilers for Parallel Computing, LCPC 2009
Country/TerritoryUnited States
CityNewark, DE

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science (all)


Dive into the research topics of 'Hardware support for OpenMP collective operations'. Together they form a unique fingerprint.

Cite this