Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
hpc-compendium
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Deploy
Releases
Package Registry
Container Registry
Model registry
Operate
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ZIH
hpcsupport
hpc-compendium
Commits
5a65424e
Commit
5a65424e
authored
1 year ago
by
Martin Schroschk
Browse files
Options
Downloads
Patches
Plain Diff
More restructuring
parent
c3a93284
Loading
Loading
2 merge requests
!920
Automated merge from preview to main
,
!918
Barnard cleanup
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
doc.zih.tu-dresden.de/docs/jobs_and_resources/barnard_test.md
+15
-15
15 additions, 15 deletions
...zih.tu-dresden.de/docs/jobs_and_resources/barnard_test.md
with
15 additions
and
15 deletions
doc.zih.tu-dresden.de/docs/jobs_and_resources/barnard_test.md
+
15
−
15
View file @
5a65424e
...
...
@@ -57,7 +57,7 @@ below. In order to support the data life cycle management, the well-known
!!! Warning
All old filesystems will be shutdown by the end of 2023.
All old filesystems
, i.e., `ssd`, `beegfs`, and `scratch`,
will be shutdown by the end of 2023.
To work with your data from Taurus you might have to move/copy them to the new storages.
Please, carefully read the following documentation and instructions.
...
...
@@ -137,10 +137,9 @@ directory on datamover mounting clusters directory on cluster
In the following, we will provide instructions with comprehensive examples for the data transfer of
your data to the new
`/home`
filesystem, as well as the working filesystems
`/data/horse`
and
`/data/walrus`
. With respect to the later, the instructions and examples are divided by the target
not the source filesystem.
`/data/walrus`
.
??? "Migration of Home Directory"
??? "Migration of
Your
Home Directory"
Your personal (old) home directory at Taurus will not be automatically transferred to the new
Barnard system. Please do not copy your entire home, but clean up your data. E.g., it might
...
...
@@ -188,24 +187,19 @@ not the source filesystem.
Please be aware that there is **no synchronisation process** between your home directories
at Taurus and Barnard. Thus, after the very first transfer, they will become divergent.
#### Migration of Working Data from Old Filesystems `ssd`, `beegfs`, and `scratch`
Please follow this instructions for transferring you data from
`ssd`
,
`beegfs`
and
`scratch`
to the
new filesystems. The instructions and examples are divided by the target not the source filesystem.
In the following, we will provide instructions for the data transfer of your old working data to the
new filesystems
`/data/horse`
and
`/data/walrus`
with comprehensive examples.
Please
**do not copy your entire work data**
from the old to the new filesystems, but consider this
opportunity for cleaning up your data. E.g., it might make sense to delete outdated scripts, old log
files, etc., and move other files, e.g., results, to the
`/data/walrus`
filesystem. Thus, please
take your time and make a plan which directories and files need to be transferred to
`/data/horse`
and which to
`/data/walrus`
. Therefor, the following instructions and examples are divided by the
target not the source filesystem.
This migration task requires a preliminary step: You need to allocate workspaces on the
target filesystems.
??? Note "
First
Step: Allocate a workspace"
??? Note "
Preliminary
Step: Allocate a workspace"
Both `/data/horse/` and `/data/walrus` can only be used with
[workspaces](../data_lifecycle/workspaces.md). Before you invoke any data transer from the old
working filesystems to the new ones, you need to allocate a workspace first.
The command `ws_list -l` lists the available and the default filesystem for worspaces.
The command `ws_list -l` lists the available and the default filesystem for wor
k
spaces.
```
marie@barnard$ ws_list --list
...
...
@@ -220,10 +214,16 @@ target not the source filesystem.
refer to our [workspace documentation](../data_lifecycle/workspaces.md), if you need refresh
your knowledge.
The most simple command to allocate a workspace is as follows
```
marie@barnard$ ws_allocate numbercrunch 90
```
Please refer to the table holding the settings
(cf. [subection workspaces on Barnard](#workspaces-on-barnard)) for the max. duration and
`ws_allocate --help` for all available options.
??? "Migration to
`/data/horse`
"
=== "Source: old `/scratch`"
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment