Skip to content
Snippets Groups Projects
Commit fcec973a authored by Martin Schroschk's avatar Martin Schroschk
Browse files

WIP: Started reviewing

parent 5e0258d8
No related branches found
No related tags found
3 merge requests!322Merge preview into main,!319Merge preview into main,!210Merge weorkspaces.md review
# Workspaces # Workspaces
## Introduction Storage systems differ in terms of capacity, streaming bandwidth, IOPS rate etc. Price and
efficiency don't allow to have it all in one. That is why, fast parallel file systems at ZIH have
restrictions wrt. **age of files** and [quota](quotas.md). The mechanism of workspaces enables users to
better manage the data life cycle of their HPC data.
<!--Workspaces are primarily login-related.-->
The tool concept of "workspaces" is common in a large number of HPC centers.
Storage systems come in many different ways in terms of: size, streaming bandwidth, IOPS rate. !!! note
Price and efficiency don't allow to have it all in one. That is the reason why Taurus fast parallel A workspace is a directory, with an associated expiration date, created on behalf of a user in a
file systems have restrictions wrt. age of files. The mechanism of workspaces enables users to certain storage system.
better manage the data life cycle of their HPC data. Workspaces are primarily login-related. The
tool concept of "workspaces" is common in a large number of HPC centers. The idea is to request for
a workspace directory in a certain storage system - connected with an expiry date. After a grace
period the data is deleted automatically. The maximum lifetime of a workspace depends on the storage
system. All workspaces can be extended.
Use the fastest file systems according to recommendations. Please keep track of the data and move it After a grace period the data is deleted automatically. The maximum lifetime of a workspace depends
to a capacity oriented filesystem after the end of computations. on the storage system. All workspaces can be extended.
## Commands. Workspace Management. !!! tip
The lifecycle of workspaces controls with commands. The basic commands will be presented below. Use the fastest file systems according to recommendations. Please keep track of the data and
move it to a capacity oriented filesystem after the end of computations.
To list all available filesystems for using workspaces use `ws_find -l` ## Workspace Management
Output: ### List Available File Systems
``` To list all available file systems for using workspaces use
```bash
zih$ ws_find -l
Available filesystems: Available filesystems:
scratch scratch
warm_archive warm_archive
...@@ -31,13 +35,12 @@ ssd ...@@ -31,13 +35,12 @@ ssd
beegfs_global0 beegfs_global0
``` ```
### Creation of the Workspace ### Allocate of Workspace
To create a workspace in one of the listed filesystems use `ws_allocate`. It is necessary to specify To create a workspace in one of the listed filesystems use `ws_allocate`. It is necessary to specify
a unique name and the duration of the workspace. a unique name and the duration of the workspace.
``` ws_allocate: [options] <workspace_name> ``` ws_allocate: [options] <workspace_name> duration
duration
## ##
...@@ -62,7 +65,7 @@ For example: ...@@ -62,7 +65,7 @@ For example:
ws_allocate -F scratch -r 7 -m name.lastname@tu-dresden.de test-WS 90 ws_allocate -F scratch -r 7 -m name.lastname@tu-dresden.de test-WS 90
``` ```
The command creates a workspace with the name test-WS on the scratch filesystem for 90 days with an The command creates a workspace with the name `test-WS` on the `/scratch` file system for 90 days with an
e-mail reminder for 7 days before the expiration. e-mail reminder for 7 days before the expiration.
Output: Output:
...@@ -74,8 +77,7 @@ remaining extensions : 10 ...@@ -74,8 +77,7 @@ remaining extensions : 10
remaining time in days: 90 remaining time in days: 90
``` ```
<span style="color:red">Note:</span> The overview of currently used workspaces can be obtained with Note: The overview of currently used workspaces can be obtained with the `ws_list` command.
the `ws_list` command.
### Extention of the Workspace ### Extention of the Workspace
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment