HPC Environment Basics

Basics of using Linux within the context of a HPC environment along with additional guidance on common HPC cluster resource managers, originally written 2018 and updated in 2023

  1. CLI Basics

    Covers a few of the basics of using the CLI, for use as an introduction or refresher. If you would like to know more about using linux, there are a large number of tutorials available online.

    1. Logging In
    2. Understanding the CLI
    3. Moving Between Hosts
    4. Becoming the Root User
  2. Working with Data and Files

    Accessing data, common ways that data can be shared and some options for archival in a HPC environment

    1. Storage Types
    2. Your Home Directory
    3. Copying Data Between Hosts
    4. Copying Data to an HPC Environment
  3. Genders and PDSH
  4. Job Schedulers

    Information about jobs, including what they do, what different types are available and how they might be used

    1. Job Scheduler Basics
    2. Types of Compute Job
  5. SLURM

    How to useThe SLURM research environment job-scheduler - an open-source project used by many HPC environments around the world

    1. Running Jobs
    2. Using the Scheduler
    3. Further Documentation