Skip to content
Snippets Groups Projects
Commit ce5f63fe authored by Jan Frenzel's avatar Jan Frenzel
Browse files

Merge branch 'pr_641' into 'preview'

Document possibility to use alternative cache directories

Closes #641

See merge request !1151
parents 88bf5c9b b1ea04af
No related branches found
No related tags found
2 merge requests!1164Automated merge from preview to main,!1151Document possibility to use alternative cache directories
...@@ -31,6 +31,21 @@ submit jobs into the batch system. Running jobs are not affected. ...@@ -31,6 +31,21 @@ submit jobs into the batch system. Running jobs are not affected.
We have no feasible way to get the contribution of We have no feasible way to get the contribution of
a single user to a project's disk usage. a single user to a project's disk usage.
Some applications and frameworks are known to store cache or temporary data at places where quota
applies. You can change the default places using environment variables. We suggest to put such data
in `/tmp` or workspaces.
We cannot list all applications that do this, but some known ones are
| Application | Environment variable |
|:-----------------|:----------------------------------|
| Singularity | `SINGULARITY_CACHEDIR` |
| pip | `PIP_CACHE_DIR` |
| Hugging Face | `HF_HOME` and `TRANSFORMERS_CACHE`|
| Torch Extensions | `TORCH_EXTENSIONS_DIR` |
Python virtual environments and conda directories can grow quickly,
so they should also be placed inside workspaces.
## Global /projects Filesystem ## Global /projects Filesystem
For project data, we have a global project directory, that allows better collaboration between the For project data, we have a global project directory, that allows better collaboration between the
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment