From 90429f1c26c89f5261e80f5e0854c54e5df6369e Mon Sep 17 00:00:00 2001 From: Martin Schroschk <martin.schroschk@tu-dresden.de> Date: Sun, 5 Nov 2023 20:38:47 +0100 Subject: [PATCH] Refine data transfer to walrus --- .../docs/jobs_and_resources/barnard_test.md | 17 +++++++++++++---- 1 file changed, 13 insertions(+), 4 deletions(-) diff --git a/doc.zih.tu-dresden.de/docs/jobs_and_resources/barnard_test.md b/doc.zih.tu-dresden.de/docs/jobs_and_resources/barnard_test.md index ed874ea4f..ea115cc46 100644 --- a/doc.zih.tu-dresden.de/docs/jobs_and_resources/barnard_test.md +++ b/doc.zih.tu-dresden.de/docs/jobs_and_resources/barnard_test.md @@ -261,23 +261,32 @@ target filesystems. === "Source: old `/scratch`" + The old `scratch` filesystem is mounted at `/data/old/lustre/scratch2` on the datamover + nodes and the workspaces are within the subdirectories `ws/0` and `ws/1`, respectively. A + corresponding data transfer using `dtcopy` looks like + ```console - marie@barnard$ dtcopy --recursive /data/horse/lustre/scratch2/0/marie-numbercrunch /data/walrus/ws/marie-numbercrunch + marie@barnard$ dtcopy --recursive /data/old/lustre/scratch2/ws/0/marie-numbercrunch /data/walrus/ws/marie-numbercrunch ``` === "Source: old `/ssd`" + The old `ssd` filesystem is mounted at `/data/old/lustre/ssd` on the datamover nodes and the + workspaces are within the subdirectory `ws/`. A corresponding data transfer using `dtcopy` + looks like + ```console marie@barnard$ dtcopy --recursive /data/old/lustre/ssd/ /data/walrus/ws/marie-numbercrunch ``` === "Source: old `/beegfs`" - The old `beegfs` filesystem is mounted at `/data/old/beegfs` the datamover nodes. You need to - invoke a `dtcopy` command to transfer data to a workspace in `/data/walrus`, e.g., + The old `beegfs` filesystem is mounted at `/data/old/beegfs` on the datamover nodes and the + workspaces are within the subdirectories `ws/0` and `ws/1`, respectively. A corresponding + data transfer using `dtcopy` looks like ```console - marie@barnard$ dtcopy --recursive /data/old/beegfs/ /data/walrus/ws/marie-numbercrunch + marie@barnard$ dtcopy --recursive /data/old/beegfs/ws/0/marie-numbercrunch /data/walrus/ws/marie-numbercrunch ``` ??? "Migration from `/lustre/ssd` or `/beegfs`" -- GitLab