Skip to content
Snippets Groups Projects
Commit c362af8d authored by Jan Frenzel's avatar Jan Frenzel
Browse files

Replaced command ml by module (load) in big_data_frameworks.md.

parent e4ce0e9a
No related branches found
No related tags found
3 merge requests!322Merge preview into main,!319Merge preview into main,!209Added admonitions to big_data_frameworks.md; minor style updates.
...@@ -10,7 +10,7 @@ Big Data. These frameworks are also offered as software [modules](modules.md) on ...@@ -10,7 +10,7 @@ Big Data. These frameworks are also offered as software [modules](modules.md) on
for both ml and scs5 partitions. You could check module availability with the command: for both ml and scs5 partitions. You could check module availability with the command:
```bash ```bash
ml av Spark module av Spark
``` ```
**Aim** of this page is to introduce users on how to start working with **Aim** of this page is to introduce users on how to start working with
...@@ -59,7 +59,7 @@ srun -p ml -N 1 -n 1 -c 2 --gres=gpu:1 --time=01:00:00 --pty --mem-per-cpu=10000 ...@@ -59,7 +59,7 @@ srun -p ml -N 1 -n 1 -c 2 --gres=gpu:1 --time=01:00:00 --pty --mem-per-cpu=10000
Once you have the shell, load Spark using the following command: Once you have the shell, load Spark using the following command:
```bash ```bash
ml Spark module load Spark
``` ```
Before the application can be started, the Spark cluster needs to be set Before the application can be started, the Spark cluster needs to be set
...@@ -196,8 +196,8 @@ If you want to use Spark and HDFS together (or in general more than one ...@@ -196,8 +196,8 @@ If you want to use Spark and HDFS together (or in general more than one
framework), a scheme similar to the following can be used: framework), a scheme similar to the following can be used:
```bash ```bash
ml Hadoop module load Hadoop
ml Spark module load Spark
source framework-configure.sh hadoop $HADOOP_ROOT_DIR/etc/hadoop source framework-configure.sh hadoop $HADOOP_ROOT_DIR/etc/hadoop
source framework-configure.sh spark $SPARK_HOME/conf source framework-configure.sh spark $SPARK_HOME/conf
start-dfs.sh start-dfs.sh
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment