From c6763b60f39046597ec26905166a707ffde1c606 Mon Sep 17 00:00:00 2001 From: Martin Schroschk <martin.schroschk@tu-dresden.de> Date: Wed, 15 May 2024 16:02:54 +0200 Subject: [PATCH] Apply generic name for workspace --- .../docs/quickstart/getting_started.md | 27 ++++++++++--------- 1 file changed, 14 insertions(+), 13 deletions(-) diff --git a/doc.zih.tu-dresden.de/docs/quickstart/getting_started.md b/doc.zih.tu-dresden.de/docs/quickstart/getting_started.md index 95af8dde2..7296a0671 100644 --- a/doc.zih.tu-dresden.de/docs/quickstart/getting_started.md +++ b/doc.zih.tu-dresden.de/docs/quickstart/getting_started.md @@ -148,9 +148,9 @@ To start we recommend the Lustre filesystem **horse**. The following command creates a workspace ```console - marie@login$ ws_allocate -F horse -r 7 -m marie@tu-dresden.de -n test-workspace -d 90 + marie@login$ ws_allocate -F horse -r 7 -m marie@tu-dresden.de -n number_crunch -d 90 Info: creating workspace. - /data/horse/ws/marie-test-workspace + /data/horse/ws/marie-number_crunch remaining extensions : 10 remaining time in days: 90 ``` @@ -160,10 +160,10 @@ To start we recommend the Lustre filesystem **horse**. - `ws_allocate` - command to allocate - `-F horse` - on the horse filesystem - `-r 7 -m marie@tu-dresden.de` - send a reminder to `marie@tu-dresden.de` 7 days before expiration - - `-n test-workspace` - workspace name + - `-n number_crunch` - workspace name - `-d 90` - a life time of 90 days - The path to this workspace is `/data/horse/ws/marie-test-workspace`. You will need it when + The path to this workspace is `/data/horse/ws/marie-number_crunch`. You will need it when transferring data or running jobs. Find more [information on workspaces in the compendium](../data_lifecycle/workspaces.md). @@ -177,7 +177,7 @@ The approach depends on the data volume: up to 100 MB or above. Use the command `cp` to copy the file `example.R` from your ZIH home directory to a workspace: ```console - marie@login$ cp /home/marie/example.R /data/horse/ws/marie-test-workspace + marie@login$ cp /home/marie/example.R /data/horse/ws/marie-number_crunch ``` Analogously use command `mv` to move a file. @@ -191,7 +191,7 @@ The approach depends on the data volume: up to 100 MB or above. filesystem location to another: ```console - marie@login$ dtcp -r /walrus/ws/large-dataset /data/horse/ws/marie-test-workspace/data + marie@login$ dtcp -r /walrus/ws/large-dataset /data/horse/ws/marie-number_crunch/data ``` Analogously use the command `dtmv` to move a file or folder. @@ -199,31 +199,32 @@ The approach depends on the data volume: up to 100 MB or above. transfer section. ### Transferring Data *To/From* ZIH HPC Systems -<!-- [NT] currently not available + ???+ example "`scp` for transferring data to ZIH HPC systems" Copy the file `example.R` from your local machine to a workspace on the ZIH systems: ```console - marie@local$ scp /home/marie/Documents/example.R marie@dataport1.hpc.tu-dresden.de:/data/horse/ws/your_workspace/ + marie@local$ scp /home/marie/Documents/example.R marie@dataport1.hpc.tu-dresden.de:/data/horse/ws/marie-number_crunch/ Password: - example.R 100% 312 32.2KB/s 00:00`` + example.R 100% 312 32.2KB/s 00:00 ``` Note, the target path contains `dataport1.hpc.tu-dresden.de`, which is one of the - so called [dataport nodes](../data_transfer/dataport_nodes.md) that allows for data transfer from/to the outside. + so called [dataport nodes](../data_transfer/dataport_nodes.md) that allows for data transfer + from/to the outside. ???+ example "`scp` to transfer data from ZIH HPC systems to local machine" Copy the file `results.csv` from a workspace on the ZIH HPC systems to your local machine: ```console - marie@local$ scp marie@dataport1.hpc.tu-dresden.de:/data/horse/ws/marie-test-workspace/results.csv /home/marie/Documents/ + marie@local$ scp marie@dataport1.hpc.tu-dresden.de:/data/horse/ws/marie-number_crunch/results.csv /home/marie/Documents/ ``` Feel free to explore further [examples](http://bropages.org/scp) of the `scp` command and possibilities of the [dataport nodes](../data_transfer/dataport_nodes.md). ---> + !!! caution "Terabytes of data" If you are planning to move terabytes or even more from an outside machine into ZIH systems, @@ -423,7 +424,7 @@ See [Slurm documentation](../jobs_and_resources/slurm.md#interactive-jobs) for m ```console marie@login$ srun --ntasks=1 --cpus-per-task=4 --time=1:00:00 --mem-per-cpu=1700 --pty bash -l #allocate 4 cores for the interactive job marie@compute$ module load Python #load necessary packages -marie@compute$ cd /data/horse/ws/marie-test-workspace/ #go to your created workspace +marie@compute$ cd /data/horse/ws/marie-number_crunch/ #go to your created workspace marie@compute$ python test.py #execute your file Hello, World! ``` -- GitLab