From cf43d0d4bd68ff05eb0d622909d2360dda28a2f2 Mon Sep 17 00:00:00 2001
From: Ulf Markwardt <ulf.markwardt@tu-dresden.de>
Date: Wed, 4 Aug 2021 15:46:27 +0200
Subject: [PATCH] Lustre aus Filesystems genommen

---
 .../docs/data_lifecycle/file_systems.md       | 54 ----------------
 .../docs/data_lifecycle/lustre.md             | 61 +++++++++++++++++++
 2 files changed, 61 insertions(+), 54 deletions(-)
 create mode 100644 doc.zih.tu-dresden.de/docs/data_lifecycle/lustre.md

diff --git a/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md b/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md
index 75a958b4c..decdb1fb3 100644
--- a/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md
+++ b/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md
@@ -86,23 +86,6 @@ In case a project is above it's limits please ...
 | `BeeGFS`    | `/beegfs/global0` | 232 TB   | global       | No     | Only accessible via **todo link: workspaces - WorkSpaces**. Fastest available file system, only for large parallel applications running with millions of small I/O operations |
 | `ext4`      | `/tmp`            | 95.0 GB  | local        | No     | is cleaned up after the job automatically                                                                                                                       |
 
-### Large Files in /scratch
-
-The data containers in Lustre are called object storage targets (OST).  The capacity of one OST is
-about 21 TB. All files are striped over a certain number of these OSTs. For small and medium files,
-the default number is 2. As soon as a file grows above \~1 TB it makes sense to spread it over a
-higher number of OSTs, eg. 16. Once the file system is used \> 75%, the average space per OST is
-only 5 GB. So, it is essential to split your larger files so that the chunks can be saved!
-
-Lets assume you have a dierctory where you tar your results, e.g.  `/scratch/mark/tar`. Now, simply
-set the stripe count to a higher number in this directory with:
-
-```Bash
-lfs setstripe -c 20  /scratch/ws/mark-stripe20/tar
-```
-
-**Note:** This does not affect existing files. But all files that **will be created** in this
-directory will be distributed over 20 OSTs.
 
 ## Warm Archive
 
@@ -167,44 +150,7 @@ output.
 We do **not recommend** the usage of the "du"-command for this purpose.  It is able to cause issues
 for other users, while reading data from the filesystem.
 
-### Lustre File System
-
-These commands work for `/scratch` and `/ssd`.
-
-#### Listing Disk Usages per OST and MDT
-
-```Bash
-lfs quota -h -u username /path/to/my/data
-```
-
-It is possible to display the usage on each OST by adding the "-v"-parameter.
-
-#### Listing space usage per OST and MDT
-
-```Bash
-lfs df -h /path/to/my/data
-```
-
-#### Listing inode usage for an specific path
-
-```Bash
-lfs df -i /path/to/my/data
-```
-
-#### Listing OSTs
-
-```Bash
-lfs osts /path/to/my/data
-```
-
-#### View striping information
-
-```Bash
-lfs getstripe myfile
-lfs getstripe -d mydirectory
-```
 
-The `-d`-parameter will also display striping for all files in the directory
 
 ### BeeGFS
 
diff --git a/doc.zih.tu-dresden.de/docs/data_lifecycle/lustre.md b/doc.zih.tu-dresden.de/docs/data_lifecycle/lustre.md
new file mode 100644
index 000000000..88891bf92
--- /dev/null
+++ b/doc.zih.tu-dresden.de/docs/data_lifecycle/lustre.md
@@ -0,0 +1,61 @@
+# Lustre File System(s)
+
+
+
+### Large Files in /scratch
+
+The data containers in Lustre are called object storage targets (OST).  The capacity of one OST is
+about 21 TB. All files are striped over a certain number of these OSTs. For small and medium files,
+the default number is 2. As soon as a file grows above \~1 TB it makes sense to spread it over a
+higher number of OSTs, eg. 16. Once the file system is used \> 75%, the average space per OST is
+only 5 GB. So, it is essential to split your larger files so that the chunks can be saved!
+
+Lets assume you have a dierctory where you tar your results, e.g.  `/scratch/mark/tar`. Now, simply
+set the stripe count to a higher number in this directory with:
+
+```Bash
+lfs setstripe -c 20  /scratch/ws/mark-stripe20/tar
+```
+
+**Note:** This does not affect existing files. But all files that **will be created** in this
+directory will be distributed over 20 OSTs.
+
+
+## Useful Commands for Lustre
+These commands work for `/scratch` and `/ssd`.
+
+### Listing Disk Usages per OST and MDT
+
+```Bash
+lfs quota -h -u username /path/to/my/data
+```
+
+It is possible to display the usage on each OST by adding the "-v"-parameter.
+
+### Listing space usage per OST and MDT
+
+```Bash
+lfs df -h /path/to/my/data
+```
+
+### Listing inode usage for an specific path
+
+```Bash
+lfs df -i /path/to/my/data
+```
+
+### Listing OSTs
+
+```Bash
+lfs osts /path/to/my/data
+```
+
+### View striping information
+
+```Bash
+lfs getstripe myfile
+lfs getstripe -d mydirectory
+```
+
+The `-d`-parameter will also display striping for all files in the directory
+
-- 
GitLab