The parallel cluster becomes unresponsive, while the program runs normally on local pool workers. How can this issue be resolved?
I have developed a program that utilizes parfor to run parallel workers. The structure of the program is as follows:
parfor ix = 1:numel(param_files)
% Read the parameter files
% Run fmincon optimization
end
The program functioned normally with all param_files when executed using local workers. However, when I attempted to run it on a parallel cluster, it became unresponsive for many hours while processing one of the parameter files during the optimization phase. As a result, I had to manually stop the parallel cluster. (Note: The hardware capabilities of the parallel cluster server are equivalent to those of my local PC.)I have developed a program that utilizes parfor to run parallel workers. The structure of the program is as follows:
parfor ix = 1:numel(param_files)
% Read the parameter files
% Run fmincon optimization
end
The program functioned normally with all param_files when executed using local workers. However, when I attempted to run it on a parallel cluster, it became unresponsive for many hours while processing one of the parameter files during the optimization phase. As a result, I had to manually stop the parallel cluster. (Note: The hardware capabilities of the parallel cluster server are equivalent to those of my local PC.) I have developed a program that utilizes parfor to run parallel workers. The structure of the program is as follows:
parfor ix = 1:numel(param_files)
% Read the parameter files
% Run fmincon optimization
end
The program functioned normally with all param_files when executed using local workers. However, when I attempted to run it on a parallel cluster, it became unresponsive for many hours while processing one of the parameter files during the optimization phase. As a result, I had to manually stop the parallel cluster. (Note: The hardware capabilities of the parallel cluster server are equivalent to those of my local PC.) paralell-cluster, parallel computing toolbox, parfor MATLAB Answers — New Questions