diff --git a/Jobs/job_lumi.slrum b/Jobs/job_lumi.slurm similarity index 100% rename from Jobs/job_lumi.slrum rename to Jobs/job_lumi.slurm diff --git a/README.md b/README.md index 4d323f0..7fe55cf 100644 --- a/README.md +++ b/README.md @@ -5,48 +5,38 @@ This is a HIP version of the [FiniteVolume code](https://github.com/babrodtk/Fin ## Setup on LUMI-G Here is a step-by-step guide on installing packages on LUMI-G -### Step 1: Install rocm-5.4.6 with Easybuild -``` -export EBU_USER_PREFIX=/project/project_xxxxxx/EasyBuild -ml LUMI/24.03 partition/G -ml EasyBuild-user -export PYTHONIOENCODING=utf-8 -eb rocm-5.4.6.eb -r -``` - -### Step 2: run conda-container +### Step 1: run conda-container Installation via conda can be done as: -``` +```shell ml LUMI/24.03 partition/G -ml lumi-container-wrapper/0.3.3-cray-python-3.11.7 -``` +ml lumi-container-wrapper ``` +```shell conda-containerize new --prefix MyCondaEnv conda_environment_lumi.yml ``` where the file `conda_environment_lumi.yml` contains packages to be installed. -### Step 3: Set the env. variable to search for binaries -``` -export the bin path: export PATH="$PWD/MyCondaEnv/bin:$PATH" -``` -### An alternative: Convert to a singularity container with cotainr +### Step 1 alternative: Convert to a singularity container with cotainr ``` cotainr build my_container.sif --system=lumi-g --conda-env=conda_environment_lumi.yml ``` -### Error when running MPI. +### Step 2: Modify Slurm Job file +Update the contents of `Jobs/job_lumi.slurm`([link](Jobs/job_lumi.slurm)) to match your project allocation, +and the directories of where the simulator and Conda container is stored. + +### Step 3: Run the Slurm Job +```shell +sbatch Jobs/job_lumi.slurm +``` + +### Troubleshooting + +#### Error when running MPI. ``` `MPI startup(): PMI server not found. Please set I_MPI_PMI_LIBRARY variable if it is not a singleton case. ``` This can be resolved by exporting this: ``` -export I_MPI_PMI_LIBRARY=/opt/cray/pe/mpich/8.1.27/ofi/cray/14.0/lib/libmpi.so -``` -### Install hip-python -``` -python -m pip install -i https://test.pypi.org/simple/ hip-python==5.4.3.470.16 -``` - -The testing was done with this specific version `hip-python==5.4.3.470.16` - - +export I_MPI_PMI_LIBRARY=/opt/cray/pe/mpich/8.1.29/ofi/cray/17.0/lib/libmpi.so +``` \ No newline at end of file