Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
hpc-compendium
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Deploy
Releases
Package Registry
Container Registry
Model registry
Operate
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ZIH
hpcsupport
hpc-compendium
Commits
fcec973a
Commit
fcec973a
authored
3 years ago
by
Martin Schroschk
Browse files
Options
Downloads
Patches
Plain Diff
WIP: Started reviewing
parent
5e0258d8
No related branches found
No related tags found
3 merge requests
!322
Merge preview into main
,
!319
Merge preview into main
,
!210
Merge weorkspaces.md review
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
doc.zih.tu-dresden.de/docs/data_lifecycle/workspaces.md
+24
-22
24 additions, 22 deletions
doc.zih.tu-dresden.de/docs/data_lifecycle/workspaces.md
with
24 additions
and
22 deletions
doc.zih.tu-dresden.de/docs/data_lifecycle/workspaces.md
+
24
−
22
View file @
fcec973a
# Workspaces
# Workspaces
## Introduction
Storage systems differ in terms of capacity, streaming bandwidth, IOPS rate etc. Price and
efficiency don't allow to have it all in one. That is why, fast parallel file systems at ZIH have
restrictions wrt.
**age of files**
and
[
quota
](
quotas.md
)
. The mechanism of workspaces enables users to
better manage the data life cycle of their HPC data.
<!--Workspaces are primarily login-related.-->
The tool concept of "workspaces" is common in a large number of HPC centers.
Storage systems come in many different ways in terms of: size, streaming bandwidth, IOPS rate.
!!! note
Price and efficiency don't allow to have it all in one. That is the reason why Taurus fast parallel
A workspace is a directory, with an associated expiration date, created on behalf of a user in a
file systems have restrictions wrt. age of files. The mechanism of workspaces enables users to
certain storage system.
better manage the data life cycle of their HPC data. Workspaces are primarily login-related. The
tool concept of "workspaces" is common in a large number of HPC centers. The idea is to request for
a workspace directory in a certain storage system - connected with an expiry date. After a grace
period the data is deleted automatically. The maximum lifetime of a workspace depends on the storage
system. All workspaces can be extended.
Use the fastest file systems according to recommendations. Please keep track of the data and move it
After a grace period the data is deleted automatically. The maximum lifetime of a workspace depends
to a capacity oriented filesystem after the end of computations
.
on the storage system. All workspaces can be extended
.
## Commands. Workspace Management.
!!! tip
The lifecycle of workspaces controls with commands. The basic commands will be presented below.
Use the fastest file systems according to recommendations. Please keep track of the data and
move it to a capacity oriented filesystem after the end of computations.
To list all available filesystems for using workspaces use
`ws_find -l`
## Workspace Management
Output:
### List Available File Systems
```
To list all available file systems for using workspaces use
```
bash
zih
$
ws_find
-l
Available filesystems:
Available filesystems:
scratch
scratch
warm_archive
warm_archive
...
@@ -31,13 +35,12 @@ ssd
...
@@ -31,13 +35,12 @@ ssd
beegfs_global0
beegfs_global0
```
```
###
Creation of the
Workspace
###
Allocate of
Workspace
To create a workspace in one of the listed filesystems use
`ws_allocate`
. It is necessary to specify
To create a workspace in one of the listed filesystems use
`ws_allocate`
. It is necessary to specify
a unique name and the duration of the workspace.
a unique name and the duration of the workspace.
```
ws_allocate: [options] <workspace_name>
```
ws_allocate: [options] <workspace_name> duration
duration
##
##
...
@@ -62,7 +65,7 @@ For example:
...
@@ -62,7 +65,7 @@ For example:
ws_allocate -F scratch -r 7 -m name.lastname@tu-dresden.de test-WS 90
ws_allocate -F scratch -r 7 -m name.lastname@tu-dresden.de test-WS 90
```
```
The command creates a workspace with the name test-WS on the scratch filesystem for 90 days with an
The command creates a workspace with the name
`
test-WS
`
on the
`/
scratch
`
file
system for 90 days with an
e-mail reminder for 7 days before the expiration.
e-mail reminder for 7 days before the expiration.
Output:
Output:
...
@@ -74,8 +77,7 @@ remaining extensions : 10
...
@@ -74,8 +77,7 @@ remaining extensions : 10
remaining time in days: 90
remaining time in days: 90
```
```
<span
style=
"color:red"
>
Note:
</span>
The overview of currently used workspaces can be obtained with
Note: The overview of currently used workspaces can be obtained with the
`ws_list`
command.
the
`ws_list`
command.
### Extention of the Workspace
### Extention of the Workspace
...
...
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment