Creator of Knowledge
Information Resources Management Association
Advancing the Concepts & Practices of Information Resources Management in Modern Organizations

Programming Paradigms in High Performance Computing

Programming Paradigms in High Performance Computing
View Sample PDF
Author(s): Venkat N. Gudivada (Marshall University, USA), Jagadeesh Nandigam (Grand Valley State University, USA) and Jordan Paris (Marshall University, USA)
Copyright: 2015
Pages: 28
Source title: Research and Applications in Global Supercomputing
Source Author(s)/Editor(s): Richard S. Segall (Arkansas State University, USA), Jeffrey S. Cook (Independent Researcher, USA) and Qingyu Zhang (Shenzhen University, China)
DOI: 10.4018/978-1-4666-7461-5.ch013


View Programming Paradigms in High Performance Computing on the publisher's website for pricing and purchasing information.


Availability of multiprocessor and multi-core chips and GPU accelerators at commodity prices is making personal supercomputers a reality. High performance programming models help apply this computational power to analyze and visualize massive datasets. Problems which required multi-million dollar supercomputers until recently can now be solved using personal supercomputers. However, specialized programming techniques are needed to harness the power of supercomputers. This chapter provides an overview of approaches to programming High Performance Computers (HPC). The programming paradigms illustrated include OpenMP, OpenACC, CUDA, OpenCL, shared-memory based concurrent programming model of Haskell, MPI, MapReduce, and message-based distributed computing model of Erlang. The goal is to provide enough detail on various paradigms to help the reader understand the fundamental differences and similarities among the paradigms. Example programs are chosen to illustrate the salient concepts that define these paradigms. The chapter concludes by providing research directions and future trends in programming high performance computers.

Related Content

Miloš Kotlar. © 2021. 4 pages.
Ivan Ratković, Miljan Djordjevic. © 2021. 13 pages.
Benjamin Berg, Mor Harchol-Balter. © 2021. 23 pages.
Bryan Donyanavard, Amir M. Rahmani, Axel Jantsch, Onur Mutlu, Nikil Dutt. © 2021. 33 pages.
Assefaw Gebremedhin, Mostofa Patwary, Fredrik Manne. © 2021. 22 pages.
Nenad Korolija, Jovan Popović, Miroslav M. Bojović. © 2021. 10 pages.
Christina Pacher. © 2021. 8 pages.
Body Bottom