diff --git a/doc.zih.tu-dresden.de/docs/archive/hardware_overview_2022.md b/doc.zih.tu-dresden.de/docs/archive/hardware_overview_2022.md index 538296b4ea52aee6c99f132811af8112803adcf9..3974a2524de36f7dd2b2fdb03f5a54fa3375f6a0 100644 --- a/doc.zih.tu-dresden.de/docs/archive/hardware_overview_2022.md +++ b/doc.zih.tu-dresden.de/docs/archive/hardware_overview_2022.md @@ -31,7 +31,7 @@ users and the ZIH. - 3.5 TB local memory on NVMe device at `/tmp` - Hostnames: `taurusi[8001-8034]` - Slurm partition: `alpha` -- Further information on the usage is documented on the site [Alpha Centauri Nodes](alpha_centauri.md) +- Further information on the usage is documented on the site [Alpha Centauri Nodes](../jobs_and_resources/alpha_centauri.md) ## Island 7 - AMD Rome CPUs @@ -41,7 +41,7 @@ users and the ZIH. - 200 GB local memory on SSD at `/tmp` - Hostnames: `taurusi[7001-7192]` - Slurm partition: `romeo` -- Further information on the usage is documented on the site [AMD Rome Nodes](rome_nodes.md) +- Further information on the usage is documented on the site [AMD Rome Nodes](../jobs_and_resources/rome_nodes.md) ## Large SMP System HPE Superdome Flex @@ -53,7 +53,7 @@ users and the ZIH. - 370 TB of fast NVME storage available at `/nvme/<projectname>` - Hostname: `taurussmp8` - Slurm partition: `julia` -- Further information on the usage is documented on the site [HPE Superdome Flex](sd_flex.md) +- Further information on the usage is documented on the site [HPE Superdome Flex](../jobs_and_resources/sd_flex.md) ## IBM Power9 Nodes for Machine Learning diff --git a/doc.zih.tu-dresden.de/docs/jobs_and_resources/misc/hdfview_memory.png b/doc.zih.tu-dresden.de/docs/archive/misc/hdfview_memory.png similarity index 100% rename from doc.zih.tu-dresden.de/docs/jobs_and_resources/misc/hdfview_memory.png rename to doc.zih.tu-dresden.de/docs/archive/misc/hdfview_memory.png diff --git a/doc.zih.tu-dresden.de/docs/jobs_and_resources/misc/i4000.png b/doc.zih.tu-dresden.de/docs/archive/misc/i4000.png similarity index 100% rename from doc.zih.tu-dresden.de/docs/jobs_and_resources/misc/i4000.png rename to doc.zih.tu-dresden.de/docs/archive/misc/i4000.png diff --git a/doc.zih.tu-dresden.de/docs/jobs_and_resources/misc/smp2.png b/doc.zih.tu-dresden.de/docs/archive/misc/smp2.png similarity index 100% rename from doc.zih.tu-dresden.de/docs/jobs_and_resources/misc/smp2.png rename to doc.zih.tu-dresden.de/docs/archive/misc/smp2.png diff --git a/doc.zih.tu-dresden.de/docs/archive/slurm_profiling.md b/doc.zih.tu-dresden.de/docs/archive/slurm_profiling.md index deb9e3331aa774d11d4f167225074475eff6383f..e200c4889300a0510b8142bacf07e57d860baa0c 100644 --- a/doc.zih.tu-dresden.de/docs/archive/slurm_profiling.md +++ b/doc.zih.tu-dresden.de/docs/archive/slurm_profiling.md @@ -70,7 +70,7 @@ More information about profiling with Slurm: ## Memory Consumption of a Job If you are only interested in the maximal memory consumption of your job, you don't need profiling -at all. This information can be retrieved from within [job files](slurm.md#batch-jobs) as follows: +at all. This information can be retrieved from within [job files](../jobs_and_resources/slurm.md#batch-jobs) as follows: ```bash #!/bin/bash diff --git a/doc.zih.tu-dresden.de/docs/index.md b/doc.zih.tu-dresden.de/docs/index.md index c22ef202a4408ab09d938219fa9be8b896cd7ae1..159b202f081f786332cf8b19e4ff304447575e89 100644 --- a/doc.zih.tu-dresden.de/docs/index.md +++ b/doc.zih.tu-dresden.de/docs/index.md @@ -31,6 +31,8 @@ Please also find out the other ways you could contribute in our ## News +* **2023-06-01** [New hardware and complete re-design](jobs_and_resources/architecture_2023.md) + * **2023-01-04** [New hardware: NVIDIA Arm HPC Developer Kit](jobs_and_resources/arm_hpc_devkit.md) * **2022-01-13** [Supercomputing extension for TU Dresden](https://tu-dresden.de/zih/die-einrichtung/news/supercomputing-cluster-2022) diff --git a/doc.zih.tu-dresden.de/docs/jobs_and_resources/architecture_2023.md b/doc.zih.tu-dresden.de/docs/jobs_and_resources/architecture_2023.md new file mode 100644 index 0000000000000000000000000000000000000000..da32558e6906c320af3310029bb1f5c28baeddc5 --- /dev/null +++ b/doc.zih.tu-dresden.de/docs/jobs_and_resources/architecture_2023.md @@ -0,0 +1,3 @@ +# Architectural Redesign 2023 + +With the replacement of the Taurus system by the cluster `Barnard` \ No newline at end of file diff --git a/doc.zih.tu-dresden.de/docs/software/performance_engineering_overview.md b/doc.zih.tu-dresden.de/docs/software/performance_engineering_overview.md index 0807db9ac0b6474b9a8051639fbad6466a03df09..33dee437a5bb64f81516042f33cbacacfc239b92 100644 --- a/doc.zih.tu-dresden.de/docs/software/performance_engineering_overview.md +++ b/doc.zih.tu-dresden.de/docs/software/performance_engineering_overview.md @@ -44,7 +44,6 @@ software performance engineering or application performance engineering within s | [Perf](#perf-tools) | Produce and visualize [profile](#profile) | easy | medium | low | (no)[^2] | | [PIKA](#pika) | Show performance [profile](#profile) and [trace](#trace) | very easy | low | very low | no | | [Score-P](#score-p) | Create performance [trace](#trace) | complex | high | variable | yes | -| [Slurm](#slurm-profiler) | Produce and visualize simple [trace](#trace)| easy | low | low | no | | [Vampir](#vampir) | Visualize performance [trace](#trace) | complex | high | n.a. | n.a. | [^2]: Re-compilation is not required. Yet, to obtain more details it is recommended to re-compile with the `-g` compiler option, which adds debugging information to the executable of an application. @@ -248,18 +247,6 @@ Many raw data sources are supported by Score-P. It requires some time, training, and practice to fully benefit from the tool's features. See [Score-P](scorep.md) for further details. -### Slurm Profiler - -!!! hint "Easy to use performance visualization of entire batch jobs" - -The [Slurm Profiler](../jobs_and_resources/slurm_profiling.md) gathers performance data from every -task/node of a given [batch job](../jobs_and_resources/slurm.md). -It records a coarse-grained [trace](#trace) for subsequent analysis. -[Instrumentation](#instrumentation) of the applications under test is not needed. -The data analysis of the given set of system metrics needs to be initiated by the user with a -command line interface. -The resulting performance metrics are accessible in a simple graphical front-end that provides -time/performance graphs. ### Vampir diff --git a/doc.zih.tu-dresden.de/mkdocs.yml b/doc.zih.tu-dresden.de/mkdocs.yml index c76398406a8de70ad1908e424662e2de9a5bb538..67d23e6981ee6049e0ea803d102741b18c28fada 100644 --- a/doc.zih.tu-dresden.de/mkdocs.yml +++ b/doc.zih.tu-dresden.de/mkdocs.yml @@ -91,7 +91,6 @@ nav: - Produce Performance Overview with Perf: software/perf_tools.md - Track Slurm Jobs with PIKA: software/pika.md - Record Course of Events with Score-P: software/scorep.md - - Profile Jobs with Slurm: jobs_and_resources/slurm_profiling.md - Study Course of Events with Vampir: software/vampir.md - Measure Energy Consumption: software/energy_measurement.md - Compare System Performance with SPEChpc: software/spec.md @@ -99,6 +98,8 @@ nav: - HPC Resources and Jobs: - Overview: jobs_and_resources/overview.md - HPC Resources: + - Overview: jobs_and_resources/hardware_overview.md + - Architecture 2023: jobs_and_resources/architecture_2023.md - AMD Rome Nodes: jobs_and_resources/rome_nodes.md - NVMe Storage: jobs_and_resources/nvme_storage.md - Alpha Centauri: jobs_and_resources/alpha_centauri.md @@ -122,7 +123,7 @@ nav: - Platform LSF: archive/platform_lsf.md - BeeGFS Filesystem on Demand: archive/beegfs_on_demand.md - Jupyter Installation: archive/install_jupyter.md - - Job Profiling: jobs_and_resources/slurm_profiling.md + - Job Profiling: archive/slurm_profiling.md - Switched-Off Systems: - Overview 2022: archive/hardware_overview_2022.md - Overview: archive/systems_switched_off.md