Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
hpc-compendium
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Deploy
Releases
Package registry
Container Registry
Model registry
Operate
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ZIH
hpcsupport
hpc-compendium
Merge requests
!103
Fix checks
Code
Review changes
Check out branch
Download
Patches
Plain diff
Merged
Fix checks
warmarchive
into
preview
Overview
0
Commits
1
Pipelines
0
Changes
1
Merged
Martin Schroschk
requested to merge
warmarchive
into
preview
3 years ago
Overview
0
Commits
1
Pipelines
0
Changes
1
Expand
0
0
Merge request reports
Compare
preview
preview (base)
and
latest version
latest version
12b972fc
1 commit,
3 years ago
1 file
+
13
−
20
Side-by-side
Compare changes
Side-by-side
Inline
Show whitespace changes
Show one file at a time
doc.zih.tu-dresden.de/docs/data_management/WarmArchive.md
+
13
−
20
Options
#
**
Warm Archive
**
# Warm Archive
<span
class=
"twiki-macro RED"
></span>
**
This page is under construction.
**This page is under construction. The functionality is not there, yet.**
The functionality is not there, yet.
**
<span
class="twiki-macro ENDCOLOR">
</span>
The warm archive is intended a storage space for the duration of a
The warm archive is intended a storage space for the duration of a running HPC-DA project. It can
running HPC-DA project. It can NOT substitute a long-term archive. It
NOT substitute a long-term archive. It consists of 20 storage nodes with a net capacity of 10 PB.
consists of 20 storage nodes with a net capacity of 10 PB. Within Taurus
Within Taurus (including the HPC-DA nodes), the management software "Quobyte" enables access via
(including the HPC-DA nodes), the management software "Quobyte" enables
access via
-
native quobyte client - read-only from compute nodes, read-write
-
native quobyte client - read-only from compute nodes, read-write
from login and nvme nodes
from login and nvme nodes
-
S3 - read-write from all nodes,
-
S3 - read-write from all nodes,
-
Cinder (from OpenStack cluster).
-
Cinder (from OpenStack cluster).
For external access, you can use:
For external access, you can use:
-
S3 to
\<
bucket>.s3.taurusexport.hrsk.tu-dresden.de
-
S3 to
<bucket>
.s3.taurusexport.hrsk.tu-dresden.de
-
or normal file transfer via our taurusexport nodes (see
-
or normal file transfer via our taurusexport nodes (see
[
DataManagement
](
datamanagement.md
)
).
DataManagement).
An HPC-DA project can apply for storage space in the warm archive. This
An HPC-DA project can apply for storage space in the warm archive. This is limited in capacity and
is limited in capacity and duration.
duration.
-- Main.UlfMarkwardt - 2019-05-14
Loading