Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
hpc-compendium
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Deploy
Releases
Package Registry
Container Registry
Model registry
Operate
Terraform modules
Monitor
Incidents
Service Desk
Analyze
Value stream analytics
Contributor analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Terms and privacy
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
ZIH
hpcsupport
hpc-compendium
Commits
c6326a02
Commit
c6326a02
authored
3 years ago
by
Christoph Lehmann
Browse files
Options
Downloads
Patches
Plain Diff
software/data_analytics.md: first content draft
parent
6641219e
No related branches found
No related tags found
6 merge requests
!333
Draft: update NGC containers
,
!322
Merge preview into main
,
!319
Merge preview into main
,
!279
Draft: Machine Learning restructuring
,
!268
Update ML branch with the content from DA
,
!258
Data Analytics restructuring
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
doc.zih.tu-dresden.de/docs/software/data_analytics.md
+21
-0
21 additions, 0 deletions
doc.zih.tu-dresden.de/docs/software/data_analytics.md
with
21 additions
and
0 deletions
doc.zih.tu-dresden.de/docs/software/data_analytics.md
+
21
−
0
View file @
c6326a02
On the ZIH system, there are many possibilities for working with tools from the field of data analytics.
The boundaries between data analytics and machine learning are fluid.
Therefore, it may be worthwhile to search for a specific issue within the data analytics and machine learning sections.
The following tools are available in the ZIH system, among others:
1.
[
Python
](
data_analytics_with_python.md
)
1.
[
R
](
data_analytics_with_r.md
)
1.
[
Rstudio
](
data_analytics_with_rstudio.md
)
1.
[
Big Data framework Spark
](
big_data_frameworks_spark.md
)
1.
[
TensorFlow
](
tensorflow.md
)
1.
[
Pytorch
](
pytorch.md
)
Additional software or special versions of individual modules can be installed individually by each user.
If possible, the use of virtual environments is recommended (e.g. for Python).
Likewise software can be used within
[
containers
](
containers.md
)
.
For the transfer of larger amounts of data into and within the system, the
[
export nodes and data mover
](
../data_transfer/overview.md
)
should be used.
The data storage takes place in the
[
work spaces
](
../data_lifecycle/workspaces.md
)
.
Software modules or virtual environments can also be installed in workspaces to enable collaborative work even within larger groups.
General recommendations for setting up workflows can be found in the
[
experiments
](
../data_lifecycle/experiments.md
)
section.
This diff is collapsed.
Click to expand it.
Preview
0%
Loading
Try again
or
attach a new file
.
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Save comment
Cancel
Please
register
or
sign in
to comment