|
Derived from
|
20410426 IN480 - PARALLEL AND DISTRIBUTED COMPUTING in Computational Sciences LM-40 R LOMBARDI FLAVIO
(syllabus)
Flynn Taxonomy Shared Memory and Distributed Memory parallel architectures and GPGPU Parallel Programming Pattern: embarassingly parallel problems; work farm; partitioning; reduce; stencil parallel program performance evaluation: Speedup, Amdahl law, strong e weak scalability. SIMD Programming Shared memory with OpenMP Distributed memory with MPI Programming GPGPU using CUDA, OpenCL and SYCL. Cloud distributed computing and nove HPC approaches and technologies (K8s, OpenACC, Rust)
(reference books)
Peter Pacheco, Matthew Malensek, An Introduction to Parallel Programming, 2nd ed., Morgan Kaufmann, 2021, ISBN 9780128046050
CUDA C++ programming guide
Slides on TEAMS
|