1. Scope

Ten names: std::par, Kokkos, Level Zero, OpenMP offload, OpenCL, HIP, HSA, SYCL, CUDA Runtime, CUDA Driver, are frequently discussed as if they were alternatives to one another. They are not. They occupy five distinct levels of a single tower, and several of them are implemented in terms of others.

Two independent hardware data sources

There are two things a GPU can be asked about.

Concurrency vs. Parallelism

Terminology

在并行计算领域，计算性能的瓶颈往往不在于计算本身，而在于处理器之间的通信。如何对这种通信开销进行准确的建模和分析，是并行算法设计的重要问题。1993年，Culler等人提出了LogP模型[1]，为我们提供了一个简洁有效的抽象框架来描述并行系统中的通信行为。本文将从基础概念出发，逐步深入探讨LogP模型的各个方面。

This blog summerize some general method for installing and configuring Slurm on a single node (Debian systems).

本文总结了CSAPP一书中和memory相关的内容

During a recent project involving DCGM, I noted down some observations and have compiled them in this blog.