This lesson is in the early stages of development (Alpha version)

Python on the Cluster: Glossary

Key Points

Introduction
  • Yes, you can run python code on a cluster

Why run Python on a cluster?
  • Make sure the effort needed to run on a cluster isn’t too high

Loading Python and Virtual Environments
  • Python is loaded on the cluster through modules

  • Virtual environments store a version of python and some packages

  • Package requirements ensure consistency for versions

Running jobs
  • Submit jobs to run long-running or computationally intensive Python code

  • Create virtual environments and install packages from the Alliance wheelhouse

  • Working with local disk in a job can provide performance benefits

  • You can use the scheduler to ask for a GPU to run code on

Arrays
  • Array jobs allow you to run several jobs with a single job script

Running interactive jobs
  • Interactive jobs are a useful way to set up or solve issues with python code on a cluster

Running a notebook in a JupyterHub
  • Most Alliance clusters have a JupyterHub

Glossary

FIXME