CUDA Fortran for Scientists and Engineers

Best Practices for Efficient CUDA Fortran Programming

Gregory Ruetsch, Massimiliano Fatica

• Publisher: Morgan Kaufmann
• Year: 2024
• Print ISBN:
  9780443219771
• Edition: 2
• eBook ISBN:
  9780443219764
• Topic: Computer Science
• Subtopic: Programming Languages
• Index: Computer Science

CUDA Fortran for Scientists and Engineers: Best Practices for Efficient CUDA Fortran Programming shows how high-performance application developers can leverage the power of GPUs using Fortran, the familiar language of scientific computing and supercomputer performance benchmarking. The authors presume no prior parallel computing experience, and cover the basics along with best practices for efficient GPU computing using CUDA Fortran. In order to add CUDA Fortran to existing Fortran codes, they explain how to understand the target GPU architecture, identify computationally-intensive parts of the code, and modify the code to manage the data and parallelism and optimize performance – all in Fortran, without having to rewrite in another language.Each concept is illustrated with actual examples so you can immediately evaluate the performance of your code in comparison.This second edition provides much needed updates on how to efficiently program GPUs in CUDA Fortran. It can be used either as a tutorial on GPU programming in CUDA Fortran as well as a reference text. - Presents optimization strategies for current hardware, including Hopper generation GPUs - Includes discussions of new language and hardware features, including managed memory, tensor cores, shuffle instructions, new multi-GPU paradigms - Offers resources and strategies for porting large codes to GPUs, including language features as well as library use

Table of contents

• Cover
• Front Matter
• Table of Contents
• Copyright
• Dedication
• Contents
• Preface to the Second Edition
• Preface to the First Edition
• Acknowledgments
• List of Illustrations
• List of Tables
• Chapter 1 : Introduction
• Chapter 2 : Correctness, accuracy, and debugging
• Chapter 3 : Performance measurement and metrics
• Chapter 4 : Synchronization
• Chapter 5 : Optimization
• Chapter 6 : Porting tips and techniques
• Chapter 7 : Interfacing with CUDA C code and CUDA libraries
• Chapter 8 : Multi-GPU programming
• Chapter 9 : Monte Carlo method
• Chapter 10 : Finite difference method
• Chapter 11 : Applications of the fast Fourier transform
• Chapter 12 : Ray tracing
• Appendix A : System and environment management
• References
• Index
• Symbols