Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
hpc-compendium
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Deploy
Releases
Package registry
Container Registry
Model registry
Operate
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ZIH
hpcsupport
hpc-compendium
Commits
c3503978
Commit
c3503978
authored
3 years ago
by
Martin Schroschk
Browse files
Options
Downloads
Patches
Plain Diff
Fix markdown
parent
7d7fe9ba
No related branches found
No related tags found
3 merge requests
!322
Merge preview into main
,
!319
Merge preview into main
,
!234
Aufgeteilt
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
doc.zih.tu-dresden.de/docs/data_lifecycle/permanent.md
+17
-14
17 additions, 14 deletions
doc.zih.tu-dresden.de/docs/data_lifecycle/permanent.md
with
17 additions
and
14 deletions
doc.zih.tu-dresden.de/docs/data_lifecycle/permanent.md
+
17
−
14
View file @
c3503978
# Permanent Filesystems
# Permanent Filesystems
Do not use permanent filesystems as work directories:
!!! hint
-
Even temporary files are kept in the snapshots and in the backup tapes over a long time,
Do not use permanent filesystems as work directories:
senselessly filling the disks,
-
By the sheer number and volume of work files, they may keep the backup from working efficiently.
- Even temporary files are kept in the snapshots and in the backup tapes over a long time,
senselessly filling the disks,
- By the sheer number and volume of work files, they may keep the backup from working efficiently.
## Global /home Filesystem
## Global /home Filesystem
...
@@ -33,8 +35,8 @@ It can only be written to on the login and export nodes.
...
@@ -33,8 +35,8 @@ It can only be written to on the login and export nodes.
!!! note
!!! note
On compute nodes,
`/projects`
is mounted as read-only, because it must not be used as
On compute nodes, `/projects` is mounted as read-only, because it must not be used as
work directory and heavy I/O.
work directory and heavy I/O.
## Snapshots
## Snapshots
...
@@ -57,8 +59,9 @@ To restore a previous version of a file:
...
@@ -57,8 +59,9 @@ To restore a previous version of a file:
!!! note
!!! note
The `.snapshot` directory is embedded in a different directory structure. An `ls ../..` will not show the directory
The `.snapshot` directory is embedded in a different directory structure. An `ls ../..` will not
where you came from. Thus, for your `cp`, you should *use an absolute path* as destination.
show the directory where you came from. Thus, for your `cp`, you should *use an absolute path*
as destination.
## Backup
## Backup
...
@@ -73,8 +76,8 @@ main reason for performance degradation of the filesystem.
...
@@ -73,8 +76,8 @@ main reason for performance degradation of the filesystem.
!!! note
!!! note
If a quota is exceeded - project or home - (total size OR total number of files)
If a quota is exceeded - project or home - (total size OR total number of files)
job submission is forbidden. Running jobs are not affected.
job submission is forbidden. Running jobs are not affected.
The following commands can be used for monitoring:
The following commands can be used for monitoring:
...
@@ -83,10 +86,10 @@ The following commands can be used for monitoring:
...
@@ -83,10 +86,10 @@ The following commands can be used for monitoring:
In case a quota is above its limits:
In case a quota is above its limits:
-
Remove core dumps and temporary data
-
Remove core dumps and temporary data
-
Talk with your colleagues to identify unused or unnecessarily stored data
-
Talk with your colleagues to identify unused or unnecessarily stored data
-
Check your workflow and use
`/tmp`
or the scratch filesystems for temporary files
-
Check your workflow and use
`/tmp`
or the scratch filesystems for temporary files
-
*Systematically*
handle your important data:
-
*Systematically*
handle your important data:
-
For later use (weeks...months) at the ZIH systems, build and zip tar
-
For later use (weeks...months) at the ZIH systems, build and zip tar
archives with meaningful names or IDs and store them, e.g., in a workspace in the
archives with meaningful names or IDs and store them, e.g., in a workspace in the
[
warm archive
](
warm_archive.md
)
or an
[
archive
](
intermediate_archive.md
)
[
warm archive
](
warm_archive.md
)
or an
[
archive
](
intermediate_archive.md
)
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment