File transfer using rsync¶
Learning outcomes
- Practice using the documentation of your favorite HPC cluster
- Can transfer files using
rsync
For teachers
Teaching goals are:
- Learners have practiced using the documentation of their favorite HPC cluster
- Learners have transferred files using
rsync
Prior questions:
- How can one do a file transfer from the terminal?
- Can you name some programs that can do file transfer from the terminal?
- Who has heard of
rsync? - Who has already used
rsync?
Notes:
- Bianca users will have the most complex procedure by far
Why?¶
Fairly sure you'll want to upload or download files to your favorite HPC cluster. Here we do so.
We use a free and open-source command-line tool to do this,
called rsync.
It works under Linux, Mac and Windows.
Exercises¶
Need a video?
| HPC Cluster | Link to documentation |
|---|---|
| Alvis | here |
| Berzelius | . |
| Bianca | here |
| COSMOS | . |
| Dardel | here |
| Kebnekaise | . |
| LUMI | . |
| Rackham | here |
| Tetralith | here |
| Vera | . |
How difficult will this be?
This depends mostly on your HPC cluster:
| HPC Cluster | Difficulty | Reason |
|---|---|---|
| Alvis | Medium | No specialized documentation |
| Berzelius | Easy | Has specialized documentation |
| Bianca | Hard | Has specialized documentation, complex procedure |
| COSMOS | Medium | No specialized documentation |
| Dardel | Medium | No specialized documentation |
| Kebnekaise | Easy | Has specialized documentation |
| LUMI | Easy | Has specialized documentation |
| Rackham | Easy | Has specialized documentation |
| Tetralith | Easy | Has specialized documentation |
| Vera | Easy | Has specialized documentation |
Exercise 1: transfer a file¶
Use the documentation of your HPC cluster.
- For maximally 5 minutes, search for how to transfer files
to/from your HPC cluster
using
rsync. Which URL is it described? Take a look at the answer if you cannot find it: sometimes there is no documentation
Where is that documentation?
| HPC Cluster | Link to documentation |
|---|---|
| Alvis | Closest is here. For now, use here |
| Berzelius | Here |
| Bianca | Here |
| COSMOS | None. Closest is here. Use the scp documentation and replace scp by rsync |
| Dardel | Closest is here |
| Kebnekaise | Here |
| LUMI | here |
| Rackham | Here |
| Tetralith | Here |
| Vera | Here |
If the center maintaining you HPC cluster has not documented how to use
rsync, follow the Rackham documentation.
- Copy a file from your local computer to your Rackham home folder. Verify this worked.
- Copy a file from your Rackham home folder to your local computer. Verify this worked.