diff --git a/doc.zih.tu-dresden.de/docs/archive/knl_nodes.md b/doc.zih.tu-dresden.de/docs/archive/knl_nodes.md index 78e4cabc7b4f40574e084834d69175cdd9fa29ef..060caf55a07a76ad12f164e0a807aa8bc090c57b 100644 --- a/doc.zih.tu-dresden.de/docs/archive/knl_nodes.md +++ b/doc.zih.tu-dresden.de/docs/archive/knl_nodes.md @@ -1,57 +1,53 @@ # Intel Xeon Phi (Knights Landing) -Xeon Phi nodes are **Out of Service**! +!!! warning + + This page is deprceated. The Xeon Phi nodes are **out of service**. The nodes `taurusknl[1-32]` are equipped with -- Intel Xeon Phi procesors: 64 cores Intel Xeon Phi 7210 (1,3 GHz) +- Intel Xeon Phi processors: 64 cores Intel Xeon Phi 7210 (1,3 GHz) - 96 GB RAM DDR4 - 16 GB MCDRAM - `/scratch`, `/lustre/ssd`, `/projects`, `/home` are mounted Benchmarks, so far (single node): -- HPL (Linpack): 1863.74 GFlops -- SGEMM (single precision) MKL: 4314 GFlops +- HPL (LINPACK): 1863.74 GFLOPS +- SGEMM (single precision) MKL: 4314 GFLOPS - Stream (only 1.4 GiB memory used): 431 GB/s Each of them can run 4 threads, so one can start a job here with e.g. -```Bash +```console srun -p knl -N 1 --mem=90000 -n 1 -c 64 a.out ``` -In order to get their optimal performance please re-compile your code -with the most recent Intel compiler and explicitely set the compiler -flag `-xMIC-AVX512`. +In order to get their optimal performance please re-compile your code with the most recent Intel +compiler and explicitly set the compiler flag `-xMIC-AVX512`. -MPI works now, we recommend to use the latest Intel MPI version -(intelmpi/2017.1.132). To utilize the OmniPath Fabric properly, make -sure to use the "ofi" fabric provider, which is the new default set by -the module file. +MPI works now, we recommend to use the latest Intel MPI version (intelmpi/2017.1.132). To utilize +the OmniPath Fabric properly, make sure to use the "ofi" fabric provider, which is the new default +set by the module file. -Most nodes have a fixed configuration for cluster mode (Quadrant) and -memory mode (Cache). For testing purposes, we have configured a few -nodes with different modes (other configurations are possible upon -request): +Most nodes have a fixed configuration for cluster mode (Quadrant) and memory mode (Cache). For +testing purposes, we have configured a few nodes with different modes (other configurations are +possible upon request): | Nodes | Cluster Mode | Memory Mode | |:-------------------|:-------------|:------------| | `taurusknl[1-28]` | Quadrant | Cache | -| `taurusknl29` | Quadrant | Flat | +| `taurusknl29` | Quadrant | Flat | | `taurusknl[30-32]` | SNC4 | Flat | -They have SLURM features set, so that you can request them specifically -by using the SLURM parameter `--constraint` where multiple values can -be linked with the & operator, e.g. `--constraint="SNC4&Flat"`. If you -don't set a constraint, your job will run preferably on the nodes with -Quadrant+Cache. +They have Slurm features set, so that you can request them specifically by using the Slurm parameter +`--constraint` where multiple values can be linked with the & operator, e.g. +`--constraint="SNC4&Flat"`. If you don't set a constraint, your job will run preferably on the nodes +with Quadrant+Cache. -Note that your performance might take a hit if your code is not -NUMA-aware and does not make use of the Flat memory mode while running -on the nodes that have those modes set, so you might want to use -`--constraint="Quadrant&Cache"` in such a case to ensure your job does not -run on an unfavorable node (which might happen if all the others are -already allocated). +Note that your performance might take a hit if your code is not NUMA-aware and does not make use of +the Flat memory mode while running on the nodes that have those modes set, so you might want to use +`--constraint="Quadrant&Cache"` in such a case to ensure your job does not run on an unfavorable +node (which might happen if all the others are already allocated). -[Knl Best Practice Guide](https://prace-ri.eu/training-support/best-practice-guides/best-practice-guide-knights-landing/) +[KNL Best Practice Guide](https://prace-ri.eu/training-support/best-practice-guides/best-practice-guide-knights-landing/) diff --git a/doc.zih.tu-dresden.de/mkdocs.yml b/doc.zih.tu-dresden.de/mkdocs.yml index 0f1292799c3a74b634602dc49cd9bfe9650cf1eb..f4abc99639ea7aed92617af52f47c018262df17e 100644 --- a/doc.zih.tu-dresden.de/mkdocs.yml +++ b/doc.zih.tu-dresden.de/mkdocs.yml @@ -114,7 +114,6 @@ nav: - Bio Informatics: archive/bioinformatics.md - CXFS End of Support: archive/cxfs_end_of_support.md - Debugging Tools: archive/debugging_tools.md - - KNL Nodes: archive/knl_nodes.md - Load Leveler: archive/load_leveler.md - Migrate to Atlas: archive/migrate_to_atlas.md - No IB Jobs: archive/no_ib_jobs.md @@ -129,6 +128,7 @@ nav: - System Titan: archive/system_titan.md - System Triton: archive/system_triton.md - System Venus: archive/system_venus.md + - KNL Nodes: archive/knl_nodes.md - Taurus II: archive/taurus_ii.md - UNICORE Rest API: archive/unicore_rest_api.md - Vampir Trace: archive/vampir_trace.md diff --git a/doc.zih.tu-dresden.de/wordlist.aspell b/doc.zih.tu-dresden.de/wordlist.aspell index 01487c58c6f71f1bbcf1695f62038c91a4422ec9..b370f1063922b72e3d78055d41bd6524214d0793 100644 --- a/doc.zih.tu-dresden.de/wordlist.aspell +++ b/doc.zih.tu-dresden.de/wordlist.aspell @@ -92,3 +92,10 @@ gnuplot RSA SHA pipelining +LINPACK +HPL +SGEMM +Xeon +DDR +GiB +KNL