Hi all,
I am trying make predictions with a machine learning model. I want to excercise the parellel processing on a HPC cluster with 128 cores. I run the script ‘step_4.m’ with slurm.sh. Unfortunately, the input files are not getting processed in parellel, rather they are processed one by one. Could any offer a help?
Thank you!
slurm.sh
#!/bin/bash
#SBATCH –job-name=ml_test
#SBATCH –output=matlab_job_output.log
#SBATCH –error=matlab_job_error.log
# CHANGE TO YOUR EMAIL ADDRESS
#SBATCH –mail-type=END
#SBATCH –mail-user=xyz@oregonstate.edu
#SBATCH –partition=preempt.q
#SBATCH –nodes=1
#SBATCH –ntasks-per-node=128
#Load MATLAB module
module load matlab/R2023b
#Run MATLAB script
matlab -nodisplay -nodesktop < step_4.m

p.s. step_4_.m script is attachedHi all,
I am trying make predictions with a machine learning model. I want to excercise the parellel processing on a HPC cluster with 128 cores. I run the script ‘step_4.m’ with slurm.sh. Unfortunately, the input files are not getting processed in parellel, rather they are processed one by one. Could any offer a help?
Thank you!
slurm.sh
#!/bin/bash
#SBATCH –job-name=ml_test
#SBATCH –output=matlab_job_output.log
#SBATCH –error=matlab_job_error.log
# CHANGE TO YOUR EMAIL ADDRESS
#SBATCH –mail-type=END
#SBATCH –mail-user=xyz@oregonstate.edu
#SBATCH –partition=preempt.q
#SBATCH –nodes=1
#SBATCH –ntasks-per-node=128
#Load MATLAB module
module load matlab/R2023b
#Run MATLAB script
matlab -nodisplay -nodesktop < step_4.m

p.s. step_4_.m script is attached Hi all,
I am trying make predictions with a machine learning model. I want to excercise the parellel processing on a HPC cluster with 128 cores. I run the script ‘step_4.m’ with slurm.sh. Unfortunately, the input files are not getting processed in parellel, rather they are processed one by one. Could any offer a help?
Thank you!
slurm.sh
#!/bin/bash
#SBATCH –job-name=ml_test
#SBATCH –output=matlab_job_output.log
#SBATCH –error=matlab_job_error.log
# CHANGE TO YOUR EMAIL ADDRESS
#SBATCH –mail-type=END
#SBATCH –mail-user=xyz@oregonstate.edu
#SBATCH –partition=preempt.q
#SBATCH –nodes=1
#SBATCH –ntasks-per-node=128
#Load MATLAB module
module load matlab/R2023b
#Run MATLAB script
matlab -nodisplay -nodesktop < step_4.m

p.s. step_4_.m script is attached parallel computing, hpc, prediction MATLAB Answers — New Questions

​