Skip to content
Snippets Groups Projects
Commit 8e8b401e authored by Ulf Markwardt's avatar Ulf Markwardt
Browse files

updated fs

parent be2c4a4f
No related branches found
No related tags found
2 merge requests!920Automated merge from preview to main,!918Barnard cleanup
...@@ -28,26 +28,26 @@ computations, please use interactive jobs. ...@@ -28,26 +28,26 @@ computations, please use interactive jobs.
## Storage Systems ## Storage Systems
For an easier grasp on the major categories (size, speed), the
work filesystems now come with the names of animals.
### Permanent Filesystems ### Permanent Filesystems
We now have `/home`, `/projects` and `/software` in a Lustre filesystem. Snapshots We now have `/home` and `/software` in a Lustre filesystem. Snapshots
and tape backup are configured. For convenience, we will make the old home available and tape backup are configured. (`/projects` remains the same until a recabling.)
read-only as `/home_old` on the data mover nodes for the data migration period.
`/warm_archive` is mounted on the data movers, only. The Lustre filesystem `/data/walrus` is meant for larger data with a slow
access. It is installed to replace `/warm_archive`.
### Work Filesystems ### Work Filesystems
With new players with new software in the filesystem market it is getting more and more In the filesystem market with new players it is getting more and more
complicated to identify the best suited filesystem for temporary data. In many cases, complicated to identify the best suited filesystem for a specific use case. Often,
only tests can provide the right answer, for a short time. only tests can find the best setup for a specific workload.
For an easier grasp on the major categories (size, speed), the work filesystems now come
with the names of animals:
* `/data/horse` - 20 PB - high bandwidth (Lustre) * `/data/horse` - 20 PB - high bandwidth (Lustre)
* `/data/octopus` - 0.5 PB - for interactive usage (Lustre) * `/data/octopus` - 0.5 PB - for interactive usage (Lustre) - to be mounted on AlphaCentauri
* `/data/weasel` - 1 PB - for high IOPS (WEKA) - coming soon * `/data/weasel` - 1 PB - for high IOPS (WEKA) - coming 2024.
### Difference Between "Work" And "Permanent" ### Difference Between "Work" And "Permanent"
...@@ -55,8 +55,11 @@ A large number of changing files is a challenge for any backup system. To protec ...@@ -55,8 +55,11 @@ A large number of changing files is a challenge for any backup system. To protec
our snapshots and backup from work data, our snapshots and backup from work data,
`/projects` cannot be used for temporary data on the compute nodes - it is mounted read-only. `/projects` cannot be used for temporary data on the compute nodes - it is mounted read-only.
For `/home`, we create snapshots and tape backups. That's why working there,
with a high frequency of changing files is a bad idea.
Please use our data mover mechanisms to transfer worthy data to permanent Please use our data mover mechanisms to transfer worthy data to permanent
storages. storages or long-term archives.
## Migration Phase ## Migration Phase
...@@ -64,8 +67,10 @@ For about one month, the new cluster Barnard, and the old cluster Taurus ...@@ -64,8 +67,10 @@ For about one month, the new cluster Barnard, and the old cluster Taurus
will run side-by-side - both with their respective filesystems. We provide a comprehensive will run side-by-side - both with their respective filesystems. We provide a comprehensive
[description of the migration to Barnard](migration_to_barnard.md). [description of the migration to Barnard](migration_to_barnard.md).
<! --
The follwing figure provides a graphical overview of the overall process (red: user action The follwing figure provides a graphical overview of the overall process (red: user action
required): required):
![Migration timeline 2023](../jobs_and_resources/misc/migration_2023.png) ![Migration timeline 2023](../jobs_and_resources/misc/migration_2023.png)
{: align=center} {: align=center}
-->
\ No newline at end of file
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment