Load and run R

Prefer this session as video?

You can see this session as a video on YouTube:

• HPC2N

• LUNARC

• UPPMAX

Learning objectivesFor teachers

• find the module to be able to run R

• load the module to be able to run R

• run the R interpreter

• run the R command to get the list of installed R packages

• run an R script from the command-line

Introduction

To allow us to work with R on an HPC cluster, we will:

• find the module to be able to run R, so we know which versions of R we can pick from

• load the module to be able to run R, so we can actually run R

• run the R interpreter, so we can test/develop R code

• run an R script from the command-line, so we can run R code

In this session, we will follow this typical user journey.

1. Find an R module

To be able to work with R on an HPC cluster, we will need to find a module that loads a specific version of R.

HPC2N, UPPMAX, LUNARC, and most of the Swedish HPC centres use the same module system:

• the HPC2N documentation of the module system

• the LUNARC documentation of the module system

• the UPPMAX documentation of the module system

Here is how to find the modules that load different versions of R:

HPC2NLUNARCUPPMAX

From a terminal, do:

module spider R

How does the output look like?

Output at HPC2N as of 15 October 2023 (on main Kebnekaise login node):

b-an01 [~]$ module spider R

----------------------------------------------------------------------------------------
R:
----------------------------------------------------------------------------------------
Description:
R is a free software environment for statistical computing and graphics.

Versions:
R/4.0.0
R/4.0.4
R/4.1.0
R/4.1.2
R/4.1.3
Other possible modules matches:
AMPtorch  Amber  Armadillo  Arrow  Bader  BerkeleyGW  BioPerl  ...

----------------------------------------------------------------------------------------
To find other possible module matches execute:

$ module -r spider '.*R.*'

----------------------------------------------------------------------------------------
For detailed information about a specific "R" package (including how to load the modules) use the module's full name.
Note that names that have a trailing (E) are extensions provided by other modules.
For example:

$ module spider R/4.1.3
----------------------------------------------------------------------------------------

Here is how to find out how to load an R module of a specific version:

HPC2NLUNARCUPPMAX

To see how to load a specific version of R, including the prerequisites, do

module spider R/<version>

where <version> is an R version, in major.minor.patch format, for example, module spider R/4.1.2.

How does the output look like?

Your output will look similar to this:

b-an01 [~]$ module spider R/4.1.2

----------------------------------------------------------------------------
R: R/4.1.2
----------------------------------------------------------------------------
Description:
R is a free software environment for statistical computing and
graphics.


You will need to load all module(s) on any one of the lines below before
the "R/4.1.2" module is available to load.

GCC/10.2.0  CUDA/11.1.1  OpenMPI/4.0.5
GCC/10.2.0  OpenMPI/4.0.5

This module provides the following extensions:

abc.data/1.0 (E), abc/2.1 (E), abe/3.0.1 (E), abind/1.4-5 (E), acepack/1.4.1 (E),
adabag/4.2 (E), ade4/1.7-16 (E), ADGofTest/0.3 (E), aggregation/1.0.1 (E),
AICcmodavg/2.3-1 (E), akima/0.6-2.1 (E), AlgDesign/1.2.0 (E), AnalyzeFMRI/1.1-23 (E),
animation/2.6 (E), aod/1.3.1 (E), ape/5.4-1 (E), argparse/2.0.3 (E), arm/1.11-2 (E),
askpass/1.1 (E), asnipe/1.1.15 (E), assertive.base/0.0-9 (E), assertive.code/0.0-3 (E),
assertive.data.uk/0.0-2 (E), assertive.data.us/0.0-2 (E), assertive.data/0.0-3 (E),
assertive.datetimes/0.0-3 (E), assertive.files/0.0-2 (E), assertive.matrices/0.0-2 (E),
assertive.models/0.0-2 (E), assertive.numbers/0.0-2 (E), assertive.properties/0.0-4 (E),
assertive.reflection/0.0-5 (E), assertive.sets/0.0-3 (E), assertive.strings/0.0-3 (E),
assertive.types/0.0-3 (E), assertive/0.3-6 (E), assertthat/0.2.1 (E), AUC/0.3.0 (E),

2. Load an R module

When you have a found a modules to load your favorite version of R, here is how you load that module:

HPC2NLUNARCUPPMAX

After having done module spider R/4.1.2, you will get a list of which other modules needs to be loaded first, resulting in:

module load GCC/10.2.0 OpenMPI/4.0.5 R/<version>

where <version> is an R version, in major.minor.patch format, for example, module load GCC/11.2.0 OpenMPI/4.1.1 R/4.1.2

If you care about reproducibility of your programming environments and R scripts, you should always load a specific version of a module.

3. Use the R interpreter

Now you have loaded a module for a specific version of R, from the terminal, we can use the R interpreter.

Here we show:

• how to start the interpreter

• how to do a trivial R thing

• how to see the list of installed R packages

• how to load an R package

• how to quit the interpreter

3.1. Start the R interpreter

Now you have loaded a module for a specific version of R, from the terminal, we can start the R interpreter like this:

R

How does the output look like?

It will look similar to this:

R version 4.0.4 (2021-02-15) -- "Lost Library Book"
Copyright (C) 2021 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu (64-bit)

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

Natural language support but running in an English locale

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

>

3.2 how to do a trivial R thing

Warning

Only do lightweight things!

We are still on the login node, which is shared with many other users. This means, that if we do heavy calculations, all these other users are affected.

If you need to do heavy calculations:

• Submit that calculation as a batch job

• UPPMAX only: use an interactive session

This will be shown in the course in a later session

Within the R interpreter we can give R commands:

print("Hello world")

Which will give the output:

[1] "Hello world"

3.3. how to see the list of installed R packages

From within the R interpreter, we can check which packages are installed using:

installed.packages()

How does the output look like?

Output will look similar to this:

              Package      LibPath
base       "base"       "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
boot       "boot"       "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
class      "class"      "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
cluster    "cluster"    "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
codetools  "codetools"  "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
compiler   "compiler"   "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
datasets   "datasets"   "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
foreign    "foreign"    "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
graphics   "graphics"   "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
grDevices  "grDevices"  "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
grid       "grid"       "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
KernSmooth "KernSmooth" "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
lattice    "lattice"    "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
MASS       "MASS"       "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
Matrix     "Matrix"     "/sw/apps/R/x86_64/4.0.4/rackham/lib64/R/library"
...

3.4. how to load an R package

From within the R interpreter, we can load a package like:

library(ggplot2)

3.5. how to quit the interpreter

To quit the R interpreter, use the quit function:

quit()

You will get the question:

Save workspace image? [y/n/c]:

where you type n until you know what that is :-)

4. Run an R script

Now you have loaded a module for a specific version of R, from the terminal, we can run an R script like this:

Rscript <r_script_name>

where <r_script_name> is the path to an R script, for example Rscript hello.R.

Warning

Only do lightweight things!

We are still on the login node, which is shared with many other users. This means, that if we do heavy calculations, all these other users are affected.

If you need to do heavy calculations:

• Submit that calculation as a batch job

• UPPMAX only: use an interactive session

This will be shown in the course in a later session

Exercises

Exercise 1: find an R module

Note

Learning objectives

• find the module to be able to run R

Use the module system to find which versions of R are provided by your cluster’s module system.

Answer

From a terminal, do:

module spider R

You will see a list of modules that provide for different versions of R.

Exercise 2: load an R module

Note

Learning objectives

• load the module to be able to run R

For this course, we recommend these versions of R:

HPC center	R version
HPC2N	4.1.2
LUNARC	4.2.1
UPPMAX	4.1.1

Load the module for the R version recommended to use in this course.

Answer HPC2N

module load GCC/11.2.0 OpenMPI/4.1.1 R/4.1.2

Answer LUNARC

module load GCC/11.3.0 OpenMPI/4.1.4 R/4.2.1

Answer UPPMAX

module load R/4.1.1

Exercise 3: use the R interpreter

Note

Learning objectives

• run the R interpreter

• run the R command to get the list of installed R packages

Here we:

• start the R interpreter

• find out which packages are already installed

• load an R package

Exercise 3.1: start the R interpreter

Start the R interpreter.

Answer

R

Exercise 3.2: check which packages are installed

From within the R interpreter, check which packages are installed.

Answer

installed.packages()

Exercise 3.3: load a package

From within the R interpreter, load the parallel package.

Answer

library(parallel)

Exercise 4: run an R script

Note

Learning objectives

• run an R script from the command-line

In this exercise, we will run an example script.

Exercise 4.1: get an R script

Get the R script hello.R by downloading it from the terminal:

wget https://raw.githubusercontent.com/UPPMAX/R-python-julia-HPC/main/exercises/r/hello.R

Exercise 4.2: run

Run the R script called hello.R, using Rscript.

Answer HPC2N

Rscript hello.R

This will look similar to:

b-an01 [~]$ Rscript hello.R
[1] "Hello World!"
b-an01 [~]$

Answer LUNARC

Rscript hello.R

This will look similar to:

[bbrydsoe@rackham2 bbrydsoe]$ Rscript hello.R
[1] "Hello World!"
[bbrydsoe@rackham2 bbrydsoe]$

Answer UPPMAX

Rscript hello.R

This will look similar to:

[bbrydsoe@rackham2 bbrydsoe]$ Rscript hello.R
[1] "Hello World!"
[bbrydsoe@rackham2 bbrydsoe]$

Exercise 5: download and extract the tarbal with exercises

See here how to download and extract the tarbal with exercises.

Conclusions

Keypoints

One needs to:

• first find a module to run R

• load one or more modules to run R.

• if one cares about reproducibility, use explicit versions of modules

• start the R interpreter with R

• run R scripts scripts with Rscript

However:

• as we work on a login node, we can only do lightweight things

• we can only use the R packages installed with the R module

• we do not work in an isolated environment

These will be discussed in other sessions.