Chapter 10 describes the various tools available for both profiling kernel performance and debugging code.For profiling we discuss both the older CUDA nvprof command line profiler and associated NVVP GUI and the newer Nsight Systems and Nsight Compute profilers which have many options. In particular, Nsight Compute can give detail of the performance within an individual kernel which was not possible before. Our discussion of debugging is based on the tools in Microsoft Visual Studio both for conventional C++ debugging and to enhance CUDA plugins for kernel debugging. The CUDA (Next-Gen) toolset allows line by line monitoring of individual threads during kernel execution.

Chapter 10 describes the various tools available for both profiling kernel performance and debugging code.For profiling we discuss both the older CUDA nvprof command line profiler and associated NVVP GUI and the newer Nsight Systems and Nsight Compute profilers which have many options. In particular, Nsight Compute can give detail of the performance within an individual kernel which was not possible before. Our discussion of debugging is based on the tools in Microsoft Visual Studio both for conventional C++ debugging and to enhance CUDA plugins for kernel debugging. The CUDA (Next-Gen) toolset allows line by line monitoring of individual threads during kernel execution.

CUDA uses the NVCC compiler to generate GPU code. This appendix discusses some of the important options users can use to tune the performance of their code.

A key choice is where you will build your program: in a basic editor, a more sophisticated editor, or an integrated development environment. This chapter discusses how to make this choice and get the most out of your chosen tool.