Using Python in an HPC environment

Pre-requirements:

Pre-requirements
Prepare the environment

Common:

Schedule
Log in and other preparations
Use the tarball with exercises
Use a text editor
HPC clusters
NAISS projects overview
New system Arrhenius

Lessons day 1 (Intro to Python):

Link to Day 1 (Intro to Python)

Lessons day 2 (packages and analysis):

Introduction
Using packages
Installing packages
Using isolated environments
Basic batch and Slurm
Interactive work on the compute nodes
Gfx launcher/Desktop On Demand including IDEs
Using IDEs
Summary day 2
Evaluation
Python documentations at the different HPC centres

Lessons day 3 (advanced analysis):

pandas
matplotlib
seaborn
Big data with Python
Running Python in batch mode
Summary day 3
Evaluation

Lessons day 4 (parallel and ML):

Parallel computing with Python
Using GPUs with Python
Machine Learning and Deep Learning
Dimensionality Reduction
Evaluation
Summary day 4

Extra:

Acknowledgments
Other courses
Interactive sessions and Desktop On-Demand
Python bundles
More about ML
Evaluations
Conda
Extra material about isolated environments
More about interactive work
Developing in isolated environments
Jupyter at Kebnekaise
Other courses
More about packages
On Kebnekaise cluster
Lesson plans
Meeting notes
Reflections
On UPPMAX clusters

Using Python in an HPC environment

Whole course
Edit on GitHub

Whole course

Days 1-4
Dates: 2025-04-24, 2025-04-25, 2025-04-28, 2025-04-29
Author: Richel

Feedback from a learner

© Copyright 2025, UPPMAX/HPC2N/LUNARC/InfraVis.

Built with Sphinx using a theme provided by Read the Docs.