High Performance Computing for Deep Learning - NLDL 2023 Winter School

Important

• Some of the material here are adopted from HPC Carpentries https://carpentries-incubator.github.io/hpc-intro/

• Learners are expected to have basic UNIX knowledge as a prerequisite. We have prepared the following training for those who needs this https://training.pages.sigma2.no/tutorials/unix-for-hpc/

• This is a shortened version of the introduction course we deliver for NRIS user, you could access the full course here:

  • Introduction ful course: https://training.pages.sigma2.no/tutorials/hpc-intro/

  • GPUs full course: https://documentation.sigma2.no/getting_started/tutorials/gpu.html

  • Upcoming training events: https://documentation.sigma2.no/training/events.html

High Performance Computing for ML/AI (Sabry Razick (UiO/NRIS/NAIC)

• Why use a Cluster?
• Working on a remote HPC system
• Accessing software
• Scheduling jobs
• GPU-jobs
• Customising a job
• Other types of jobs

Accelerated Deep Learning on the supercomputer LUMI-G (Hicham Agueny (UiB/NRIS))

downloads/NLDL2024_dml.pdf

Accelerated Deep Learning with JAX (Magnar Bjørgve UiT/NRIS)

• Jax on LUMI-G
• Creating an Overlay for the Jax Container
• Monitoring

downloads/NLDLgpumonitoringandjax.pptx