This lesson is in the early stages of development (Alpha version)

Python on the Cluster

Are you ready to move your Python code to an HPC cluster?

This hands-on workshop (3 hours) will give students an insight into running Python code on high performance computing clusters. Includes setting up jobs for batch submission, loading dependant Python packages, and interactive use on the cluster. Students should have some experience with the shell (e.g., HPC Shell Basics workshop), experience submitting jobs (e.g., HPC Essentials workshop), and at least one introductory Python course.

Schedule

Setup Make sure you are ready for this workshop ...
00:00 1. Introduction So you want to run python code on a cluster?
00:05 2. Why run Python on a cluster? When should I run Python on an cluster?
00:10 3. Loading Python and Virtual Environments How do I run python on the cluster?
How do I install python packages?
00:50 4. Running jobs How do I submit jobs that run python code?
How do I ensure that my python job has the packages it needs?
How do I get better input/output performance?
How do I use a GPU with my code?
01:30 5. Arrays How do I submit many similar jobs?
02:10 6. Running interactive jobs How do I run jobs that allow me to interact with my python code?
How do I debug code on an interactive node?
02:40 7. Running a notebook in a JupyterHub How do I run a notebook in a JupyterHub?
How do I load specific software in a JupyterHub notebook
03:00 Finish

The actual schedule may vary slightly depending on the topics and exercises chosen by the instructor.