In the next years, high performance computing will be increasingly based on the utilization of GPUs, rather than CPUs.
Here are some useful tools to get a first orientation in this subject, provided by Alessandro Lovato
(see also the second part of the Video).
Lista top 500
GPU at CINECA
Hetereogeneous CPU+GPU computing
Drop-in blas
How to introduce minimal changes to C++
and
to Fortran codes with NVIDIA compiler
Introduction to OpenACC
OpenMP for GPU
Google-JAX