Welcome to HPC python course material

This material

Here you will find the content of the workshop Using Python in an HPC environment.

Content

  • This course aims to give a brief, but comprehensive introduction to using Python in an HPC environment.

  • You will learn how to
    • use modules to load Python

    • find site installed Python packages

    • install packages yourself

    • use virtual environments,

    • write a batch script for running Python

    • use Python in parallel

    • how to use Python for ML and on GPUs.

  • This course will consist of lectures interspersed with hands-on sessions where you get to try out what you have just learned.

Cluster-specific approaches

  • The course is a cooperation between UPPMAX (Rackham, Snowy, Bianca) and HPC2N (Kebnekaise) and will focus on the compute systems at both centres.

  • For the site-specific part of the course you will be divided into groups depending on which center you will be running your code, as the approach is somewhat different.

Preliminary schedule

Preliminary schedule

Time

Topic

Activity

9:00

Syllabus

Introduction

Lecture

Loading modules and running Python codes

Lecture+code along

Dealing with packages

Lecture+code along

Coffee

Isolated environments (general)

Lecture+code along

SLURM Batch scripts for Python jobs

Lecture+code along + exercise

Interactive

Lecture+code along

Short leg stretch

Separated sessions 1 for UPPMAX/HPC2N:isolated environments

Lecture

12:00

LUNCH

13:00

Parallelising a simple Python code

Lecture+code along + exercise

Deploying GPU:s for Python

Lecture+code along + exercise

Short leg stretch

Using Python for Machine Learning jobs

Lecture+code along

Separated sessions 2 for UPPMAX/HPC2N: Bianca/ML exercises

Lecture

Coffee

Summary

Q&A on-demand

Additional exercises

16.00

END