diff --git a/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md b/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md index 75a958b4cd21b150ab76bc525c402ebcf261176d..decdb1fb3207eb00d45434a0f830f2d9215e6b24 100644 --- a/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md +++ b/doc.zih.tu-dresden.de/docs/data_lifecycle/file_systems.md @@ -86,23 +86,6 @@ In case a project is above it's limits please ... | `BeeGFS` | `/beegfs/global0` | 232 TB | global | No | Only accessible via **todo link: workspaces - WorkSpaces**. Fastest available file system, only for large parallel applications running with millions of small I/O operations | | `ext4` | `/tmp` | 95.0 GB | local | No | is cleaned up after the job automatically | -### Large Files in /scratch - -The data containers in Lustre are called object storage targets (OST). The capacity of one OST is -about 21 TB. All files are striped over a certain number of these OSTs. For small and medium files, -the default number is 2. As soon as a file grows above \~1 TB it makes sense to spread it over a -higher number of OSTs, eg. 16. Once the file system is used \> 75%, the average space per OST is -only 5 GB. So, it is essential to split your larger files so that the chunks can be saved! - -Lets assume you have a dierctory where you tar your results, e.g. `/scratch/mark/tar`. Now, simply -set the stripe count to a higher number in this directory with: - -```Bash -lfs setstripe -c 20 /scratch/ws/mark-stripe20/tar -``` - -**Note:** This does not affect existing files. But all files that **will be created** in this -directory will be distributed over 20 OSTs. ## Warm Archive @@ -167,44 +150,7 @@ output. We do **not recommend** the usage of the "du"-command for this purpose. It is able to cause issues for other users, while reading data from the filesystem. -### Lustre File System - -These commands work for `/scratch` and `/ssd`. - -#### Listing Disk Usages per OST and MDT - -```Bash -lfs quota -h -u username /path/to/my/data -``` - -It is possible to display the usage on each OST by adding the "-v"-parameter. - -#### Listing space usage per OST and MDT - -```Bash -lfs df -h /path/to/my/data -``` - -#### Listing inode usage for an specific path - -```Bash -lfs df -i /path/to/my/data -``` - -#### Listing OSTs - -```Bash -lfs osts /path/to/my/data -``` - -#### View striping information - -```Bash -lfs getstripe myfile -lfs getstripe -d mydirectory -``` -The `-d`-parameter will also display striping for all files in the directory ### BeeGFS diff --git a/doc.zih.tu-dresden.de/docs/data_lifecycle/lustre.md b/doc.zih.tu-dresden.de/docs/data_lifecycle/lustre.md new file mode 100644 index 0000000000000000000000000000000000000000..88891bf92213c011a0dda088632581a164660330 --- /dev/null +++ b/doc.zih.tu-dresden.de/docs/data_lifecycle/lustre.md @@ -0,0 +1,61 @@ +# Lustre File System(s) + + + +### Large Files in /scratch + +The data containers in Lustre are called object storage targets (OST). The capacity of one OST is +about 21 TB. All files are striped over a certain number of these OSTs. For small and medium files, +the default number is 2. As soon as a file grows above \~1 TB it makes sense to spread it over a +higher number of OSTs, eg. 16. Once the file system is used \> 75%, the average space per OST is +only 5 GB. So, it is essential to split your larger files so that the chunks can be saved! + +Lets assume you have a dierctory where you tar your results, e.g. `/scratch/mark/tar`. Now, simply +set the stripe count to a higher number in this directory with: + +```Bash +lfs setstripe -c 20 /scratch/ws/mark-stripe20/tar +``` + +**Note:** This does not affect existing files. But all files that **will be created** in this +directory will be distributed over 20 OSTs. + + +## Useful Commands for Lustre +These commands work for `/scratch` and `/ssd`. + +### Listing Disk Usages per OST and MDT + +```Bash +lfs quota -h -u username /path/to/my/data +``` + +It is possible to display the usage on each OST by adding the "-v"-parameter. + +### Listing space usage per OST and MDT + +```Bash +lfs df -h /path/to/my/data +``` + +### Listing inode usage for an specific path + +```Bash +lfs df -i /path/to/my/data +``` + +### Listing OSTs + +```Bash +lfs osts /path/to/my/data +``` + +### View striping information + +```Bash +lfs getstripe myfile +lfs getstripe -d mydirectory +``` + +The `-d`-parameter will also display striping for all files in the directory +