New computer systems, frameworks, and chips appear every year. Nobody can learn them all. But almost every one of them is built on the same small set of ideas. If you understand these ideas deeply, you can reason about any system, even one you have never seen before.
Ten names: std::par, Kokkos, Level Zero, OpenMP offload, OpenCL, HIP, HSA, SYCL, CUDA Runtime, CUDA Driver, are frequently discussed as if they were alternatives to one another. They are not. They occupy five distinct levels of a single tower, and several of them are implemented in terms of others.
There are two things a GPU can be asked about.
在并行计算领域，计算性能的瓶颈往往不在于计算本身，而在于处理器之间的通信。如何对这种通信开销进行准确的建模和分析，是并行算法设计的重要问题。1993年，Culler等人提出了LogP模型[1]，为我们提供了一个简洁有效的抽象框架来描述并行系统中的通信行为。本文将从基础概念出发，逐步深入探讨LogP模型的各个方面。
This blog summerize some general method for installing and configuring Slurm on a single node (Debian systems).
本文总结了CSAPP一书中和memory相关的内容