Skip to content
Snippets Groups Projects
Commit 1328ba7d authored by Jan Frenzel's avatar Jan Frenzel
Browse files

Merge branch 'preview' into 218-apache-flink

parents ff90571b bce1a91d
No related branches found
No related tags found
2 merge requests!423Automated merge from preview to main,!419Mentioned also Flink where Spark is mentioned
...@@ -9,9 +9,13 @@ that you cannot log in via SSH to the export nodes, but only use `scp`, `rsync` ...@@ -9,9 +9,13 @@ that you cannot log in via SSH to the export nodes, but only use `scp`, `rsync`
The export nodes are reachable under the hostname `taurusexport.hrsk.tu-dresden.de` (or The export nodes are reachable under the hostname `taurusexport.hrsk.tu-dresden.de` (or
`taurusexport3.hrsk.tu-dresden.de` and `taurusexport4.hrsk.tu-dresden.de`). `taurusexport3.hrsk.tu-dresden.de` and `taurusexport4.hrsk.tu-dresden.de`).
Please keep in mind that there are different
[filesystems](../data_lifecycle/file_systems.md#recommendations-for-filesystem-usage). Choose the
one that matches your needs.
## Access From Linux ## Access From Linux
There are at least three tool to exchange data between your local workstation and ZIH systems. All There are at least three tools to exchange data between your local workstation and ZIH systems. They
are explained in the following section in more detail. are explained in the following section in more detail.
!!! important !!! important
...@@ -33,13 +37,27 @@ in a directory, the option `-r` has to be specified. ...@@ -33,13 +37,27 @@ in a directory, the option `-r` has to be specified.
marie@local$ scp -r <directory> taurusexport:<target-location> marie@local$ scp -r <directory> taurusexport:<target-location>
``` ```
??? example "Example: Copy a file from ZIH systems to your workstation" For example, if you want to copy your data file `mydata.csv` to the directory `input` in your
home directory, you would use the following:
```console ```console
marie@login$ scp taurusexport:<file> <target-location> marie@local$ scp mydata.csv taurusexport:input/
```
??? example "Example: Copy a file from ZIH systems to your workstation"
```bash
marie@local$ scp taurusexport:<file> <target-location>
# Add -r to copy whole directory # Add -r to copy whole directory
marie@login$ scp -r taurusexport:<directory> <target-location> marie@local$ scp -r taurusexport:<directory> <target-location>
```
For example, if you have a directory named `output` in your home directory on ZIH systems and
you want to copy it to the directory `/tmp` on your workstation, you would use the following:
```console
marie@local$ scp -r taurusexport:output /tmp
``` ```
### SFTP ### SFTP
......
#!/bin/bash
set -euo pipefail
scriptpath=${BASH_SOURCE[0]}
basedir=`dirname "$scriptpath"`
basedir=`dirname "$basedir"`
if find $basedir -name \*.md -exec wc -l {} \; | grep '^0 '; then
exit 1
fi
...@@ -37,6 +37,9 @@ i attachurl ...@@ -37,6 +37,9 @@ i attachurl
Replace \"todo\" with real content. Replace \"todo\" with real content.
i \<todo\> <!--.*todo.*--> i \<todo\> <!--.*todo.*-->
Replace \"Coming soon\" with real content.
i \<coming soon\>
Avoid spaces at end of lines. Avoid spaces at end of lines.
i [[:space:]]$ i [[:space:]]$
......
...@@ -75,6 +75,13 @@ then ...@@ -75,6 +75,13 @@ then
exit_ok=no exit_ok=no
fi fi
echo "Looking for empty files..."
docker run --name=hpc-compendium --rm -w /docs --mount src="$(pwd)",target=/docs,type=bind hpc-compendium ./doc.zih.tu-dresden.de/util/check-empty-page.sh
if [ $? -ne 0 ]
then
exit_ok=no
fi
if [ $exit_ok == yes ] if [ $exit_ok == yes ]
then then
exit 0 exit 0
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment