diff --git a/doc.zih.tu-dresden.de/docs/data_lifecycle/intermediate_archive.md b/doc.zih.tu-dresden.de/docs/data_lifecycle/intermediate_archive.md index 167744f9afaf49386f6c5a9f75638e1946482854..58ce7f4a41bcaf3da9cf8d1eff080bc95221fe33 100644 --- a/doc.zih.tu-dresden.de/docs/data_lifecycle/intermediate_archive.md +++ b/doc.zih.tu-dresden.de/docs/data_lifecycle/intermediate_archive.md @@ -25,21 +25,21 @@ For storing and restoring your data in/from the "Intermediate Archive" you can u ### Store Data ```console -marie@login$ dtcp -r /<directory> /archiv/<project or user>/<directory> # or -marie@login$ dtrsync -av /<directory> /archiv/<project or user>/<directory> +marie@login$ dtcp -r /<directory> /data/archiv/<project or user>/<directory> # or +marie@login$ dtrsync -av /<directory> /data/archiv/<project or user>/<directory> # example: -marie@login$ dtcp -r /scratch/marie/results /archiv/marie/ # or -marie@login$ dtrsync -av /scratch/marie/results /archiv/marie/results +marie@login$ dtcp -r /scratch/marie/results /data/archiv/marie/ # or +marie@login$ dtrsync -av /scratch/marie/results /data/archiv/marie/results ``` ### Restore Data ```console -marie@login$ dtcp -r /archiv/<project or user>/<directory> /<directory> # or -marie@login$ dtrsync -av /archiv/<project or user>/<directory> /<directory> +marie@login$ dtcp -r /data/archiv/<project or user>/<directory> /<directory> # or +marie@login$ dtrsync -av /data/archiv/<project or user>/<directory> /<directory> # example: -marie@login$ dtcp -r /archiv/marie/results /scratch/marie/ # or -marie@login$ dtrsync -av /archiv/marie/results /scratch/marie/results +marie@login$ dtcp -r /data/archiv/marie/results /scratch/marie/ # or +marie@login$ dtrsync -av /data/archiv/marie/results /scratch/marie/results ``` !!! note "Listing files in archive" @@ -49,5 +49,5 @@ marie@login$ dtrsync -av /archiv/marie/results /scratch/marie/results In order to list the user's files in the archive use the `dtls` command ```console - marie@login$ dtls /archiv/$USER/ + marie@login$ dtls /data/archiv/$USER/ ``` diff --git a/doc.zih.tu-dresden.de/docs/data_lifecycle/permanent.md b/doc.zih.tu-dresden.de/docs/data_lifecycle/permanent.md index 6ad3e771e633a4a0ef20e20a75e282aada8c3d3b..40aeead13825e40a02047f0c696f87bc7569edd3 100644 --- a/doc.zih.tu-dresden.de/docs/data_lifecycle/permanent.md +++ b/doc.zih.tu-dresden.de/docs/data_lifecycle/permanent.md @@ -62,7 +62,7 @@ main reason for performance degradation of the filesystem. The following commands can be used for monitoring: -- `showquota` shows your projects' usage of the filesystem. +- `show_resources` shows your projects' usage of the filesystem. - `quota -s -f /home` shows the user's usage of the filesystem. In case a quota is above its limits: diff --git a/doc.zih.tu-dresden.de/docs/software/containers.md b/doc.zih.tu-dresden.de/docs/software/containers.md index c870e6996df70022421324bae82afe216abaea09..08edee005bc8560569c0f0c36e9b81714b4854bb 100644 --- a/doc.zih.tu-dresden.de/docs/software/containers.md +++ b/doc.zih.tu-dresden.de/docs/software/containers.md @@ -359,4 +359,4 @@ problem. ```console marie@compute$ singularity exec /data/horse/lustre/scratch2/singularity/centos7.img ldd --version ldd (GNU libc) 2.17 -``` + ``` diff --git a/doc.zih.tu-dresden.de/docs/software/singularity_recipe_hints.md b/doc.zih.tu-dresden.de/docs/software/singularity_recipe_hints.md index 78cc40df749a52e809b8612dfb0464a24460a347..20b5c21cb7ca8c0885dca34518de5791958572a8 100644 --- a/doc.zih.tu-dresden.de/docs/software/singularity_recipe_hints.md +++ b/doc.zih.tu-dresden.de/docs/software/singularity_recipe_hints.md @@ -253,6 +253,33 @@ FPS (or runs at all). **NVIDIA GPUs** need the `--nv` parameter for the Singularity command: -``console +```console singularity exec --nv vgl.sif glxgears ``` + +### Singularity Temporary and Cache Directories + +Singularity uses `/tmp` to store temporary data, e. g., when you use `pull` or `build`. Because +there are also diskless nodes, you may use the environment variable `SINGULARITY_TMPDIR` to change +the storage place for temporary data. You can use the following line to indicate a different +location for temporary data: + +```console +export SINGULARITY_TMPDIR=$SOME_WORKSPACE/singularity_tmp +``` + +Singularity commands invoked afterwards store temporary data at the indicated location. + +!!! warning "Singularity caches data in your home directory by default" + + Another location where Singularity stores data is your home directory! This is problematic when + Singularity caches too many containers, because you cannot start Slurm jobs if you are over a + certain limit. To prevent that from happening, indicate a different location for cache space, + e. g., a [workspace](../data_lifecycle/workspaces.md): + + ```console + export SINGULARITY_CACHEDIR=$SOME_WORKSPACE/singularity_cache + ``` + +Further information on both environment variables can be found on +[the official Singularity documentation](https://docs.sylabs.io/guides/latest/user-guide/build_env.html#build-environment).