Automated merge from preview to main
Created by CI
Merge request reports
Activity
Filter activity
97 1. Open a terminal/shell/console (`Ctrl+Alt+T`) and type in 94 98 95 99 ```console 96 100 marie@local$ ssh marie@taurus.hrsk.tu-dresden.de 97 101 ``` 98 After typing your password, you end up with something like in the following image. 102 2. After typing in your password, you end up seeing something like the following image. 99 103 100 104  101 105 102 106 #### **Windows users** 103 107 104 Start [Window Terinal](https://www.microsoft.com/en-us/p/windows-terminal/9n0dx20hk701?activetab=pivot:overviewtab) (Windows 10 or higher). In older versions of Windows install and set up [MobaXTerm](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_MobaXterm.pdf) or [PuTTY](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_PuTTY.pdf). 108 1. Start [Windows Terinal](https://www.microsoft.com/en-us/p/windows-terminal/9n0dx20hk701?activetab=pivot:overviewtab) (Windows 10 or higher). In older versions of Windows install and set up [MobaXTerm](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_MobaXterm.pdf) or [PuTTY](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_PuTTY.pdf). 109 110 <!-- shouldn't there be a step 2 which indicates how to actually access the ZIH HPC? Or at least a link to Linux Users session? --> - put in a ink to the windows compendium page https://doc.zih.tu-dresden.de/access/ssh_login/#connecting-from-windows
- remove link to the pdf
- Include step 2: "follow Linux/Mac Users section above"
Edited by Neringa Jurenaite
86 83 87 84 ### SSH Connection (Command Line) 88 85 89 The more "classical" way to work with HPC is based on the command line. 86 The more "classical" way to work with HPC is based on the command line. After following the instructions below, you will be on one of the login nodes. This is the starting point for many tasks such as running programs and data management. 87 88 !!! hint "Using ssh key pair" 89 90 We recommend to creat an ssh key pair by following the [instructions here](../../access/ssh_login/#before-your-first-connection). 91 Using an ssh key pair is benefical for security reasons, although it is not necessary to work with the ZIH HPC system. 92 93 90 94 91 95 #### **Linux users** 95 99 ```console 96 100 marie@local$ ssh marie@taurus.hrsk.tu-dresden.de 97 101 ``` 98 After typing your password, you end up with something like in the following image. 102 2. After typing in your password, you end up seeing something like the following image. 99 103 100 104  101 105 102 106 #### **Windows users** 103 107 104 Start [Window Terinal](https://www.microsoft.com/en-us/p/windows-terminal/9n0dx20hk701?activetab=pivot:overviewtab) (Windows 10 or higher). In older versions of Windows install and set up [MobaXTerm](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_MobaXterm.pdf) or [PuTTY](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_PuTTY.pdf). 108 1. Start [Windows Terinal](https://www.microsoft.com/en-us/p/windows-terminal/9n0dx20hk701?activetab=pivot:overviewtab) (Windows 10 or higher). In older versions of Windows install and set up [MobaXTerm](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_MobaXterm.pdf) or [PuTTY](https://doc.zih.tu-dresden.de/access/misc/basic_usage_of_PuTTY.pdf). 109 110 <!-- shouldn't there be a step 2 which indicates how to actually access the ZIH HPC? Or at least a link to Linux Users session? --> 105 111 106 112 #### **Mac Users** 109 115 110 Now, you (both **Linux** and **Windows** users) have accessed one of the login nodes. 111 This is the starting point for many tasks as e.g. running programs or data management. 112 113 !!! hint "Using ssh key pair" 114 115 We recommend to creat an ssh key pair by following the [instructions here](../../access/ssh_login/#before-your-first-connection). 116 Using an ssh key pair is benefical for security reasons, although it is not necessary to work with the ZIH HPC system. 117 116 118 117 ## Data Management and Data Transfer 119 118 120 119 There are different areas for storing your data on the ZIH HPC system, called [Filesystems](https://doc.zih.tu-dresden.de/data_lifecycle/file_systems/). 121 120 You will need to create a [workspace](https://doc.zih.tu-dresden.de/data_lifecycle/workspaces/) for your data (see example below) on one of these Filesystems. 122 121 123 The filesystems have different properties (available space, storage time limit, permission rights). 122 The filesystems have different [properties](https://doc.zih.tu-dresden.de/data_lifecycle/file_systems/) (available space, storage time limit, permission rights). 166 164 Moving files is done analagously by using the command `mv`. 167 165 168 166 169 ??? example "Copy file(s) within ZIH system (large data)" 167 ??? example "b) Large Data (above 100 MB)" 187 185 Password: 188 186 example1.R 100% 312 32.2KB/s 00:00`` 189 187 ``` 190 188 191 Note that the target path contains `taurusexport.hrsk.tu-dresden.de` which is one of the so called export nodes that allow for data transfer from/to outside the ZIH system. 189 Note that the target path contains `taurusexport.hrsk.tu-dresden.de`, which is one of the so called export nodes that allow for data transfer from/to the outside. 192 190 193 * Copy the file `results.csv` **from a workspace on the ZIH system to your local machine**. 191 * Copy the file `results.csv` **from a workspace on the ZIH system to your local machine**: 194 192 ```console 195 193 marie@local$ scp marie@taurusexport.hrsk.tu-dresden.de:/scratch/ws/0/marie-test-workspace/results.csv home/marie/Documents/ 196 194 ``` 197 195 198 Find [here more examples for the scp command](http://bropages.org/scp). 199 Furthermore, checkout the other possiblities in the [compendium for working with the export nodes](../data_transfer/export_nodes.md). 196 Find more examples for the scp command [here]](http://bropages.org/scp). 297 292 298 293 You will need to load all module(s) on any one of the lines below before the "Python/3.9.5" module is available to load. 299 294 300 modenv/hiera GCCcore/10.3.0 295 *modenv/hiera GCCcore/10.3.0* 342 337 343 338 ??? hint "Special hints on different software" 344 339 345 Special hints on different software can be found for [Python](../software/data_analytics_with_python.md), 340 Special hints on different software can be found [here for Python](../software/data_analytics_with_python.md), 372 363 373 Here, among the other options it is possible to define a partition you would like to work on 374 (`--partition`), the number of tasks (`--ntasks`), number of CPUs per task (`--cpus-per-task`), 375 the amount of time you would like to keep this interactive session open (`--time`), memory per 376 CPU (`--mem-per-cpu`) and many others. See [Slurm documentation](../jobs_and_resources/slurm.md#interactive-jobs) 377 for more details. 364 Here, among the other options it is possible to define a partition you would like to work on (`--partition`), the number of tasks (`--ntasks`), number of CPUs per task (`--cpus-per-task`), the amount of time you would like to keep this interactive session open (`--time`), memory per CPU (`--mem-per-cpu`) and many others. See [Slurm documentation](../jobs_and_resources/slurm.md#interactive-jobs) for more details. 378 365 379 366 ```console 380 marie@login$ srun --partition=haswell --ntasks=1 --cpus-per-task=4 --time=1:00:00 --mem-per-cpu=1700 --pty bash -l 367 marie@login$ srun --partition=haswell --ntasks=1 --cpus-per-task=4 --time=1:00:00 --mem-per-cpu=1700 --pty bash -l #allocate 4 cores for the interactive job 381 368 ``` 382 383 The `srun` call will allocate 4 cores for an interactive job. 384 385 <!-- maybe run next a concrete job? --> added Bot label
assigned to @s2817051--tu-dresden.de
mentioned in commit 978d9d7f
Please register or sign in to reply