Worker crashed while executing code
Warning: 1 worker(s) crashed while executing code in the current parallel pool. MATLAB may attempt to run the code again on the remaining workers of the pool, unless an spmd block has run. View the crash dump files to determine what caused the workers to crash.
As I have the home licenses I’m not sure what to do with the error above. The script is training a Trebagger model with parallel turned on. It does use a lot of memory but still fits within the 32GB I have. The log is :-
——————————————————————————–
abort() detected at 2024-06-09 14:55:26 +0100
——————————————————————————–
Configuration:
Crash Decoding : Disabled – No sandbox or build area path
Crash Mode : continue (default)
Default Encoding : UTF-8
Deployed : false
Graphics Driver : Uninitialized hardware
Graphics card 1 : NVIDIA ( 0x10de ) NVIDIA GeForce RTX 3060 Ti Version 32.0.15.5599 (2024-6-1)
Graphics card 2 : Intel Corporation ( 0x8086 ) Intel(R) UHD Graphics 770 Version 31.0.101.4577 (2023-7-24)
Java Version : Java 1.8.0_202-b08 with Oracle Corporation Java HotSpot(TM) 64-Bit Server VM mixed mode
MATLAB Architecture : win64
MATLAB Entitlement ID : 5834768
MATLAB Root : C:Program FilesMATLABR2024a
MATLAB Version : 24.1.0.2603908 (R2024a) Update 3
OpenGL : hardware
Operating System : Microsoft Windows 11 Home
Process ID : 24484
Processor ID : x86 Family 6 Model 151 Stepping 2, GenuineIntel
Session Key : 21d9c0b4-6172-4c58-b200-f26395bd30e7
Window System : Version 10.0 (Build 22631)
Fault Count: 1
Abnormal termination:
abort()
Current Thread: ” id 15936
Register State (captured):
RAX = 00007ffc736e7208 RBX = 00007ffc736e7208
RCX = 0000000b268f8790 RDX = 00007ffc736918f0
RSP = 0000000b268f86d0 RBP = 0000000b268f9460
RSI = 0000000000000000 RDI = 00007ffc736e7208
R8 = 0000000000000003 R9 = 0000000b268f8648
R10 = 0000000000000014 R11 = 0000000000000000
R12 = 0000000b268f9368 R13 = 0000000000000000
R14 = 00007ffc736d7138 R15 = 0000000b268f8da0
RIP = 00007ffc735d1c8a EFL = 00000202
CS = 0033 FS = 0053 GS = 002b
Stack Trace (captured):
[ 0] 0x00007ffc735cb093 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00045203 foundation::core::diag::thread_context::unspecified_bool+00000051
[ 1] 0x00007ffc735c94c8 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00038088 foundation::core::diag::stacktrace_base::capture+00000024
[ 2] 0x00007ffc735cd90f C:Program FilesMATLABR2024abinwin64libmwfl.dll+00055567 foundation::core::diag::symbols::getSymbolAddress+00009855
[ 3] 0x00007ffc735d07d7 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00067543 foundation::core::diag::is_terminate_message_enabled+00000503
[ 4] 0x00007ffbf21c1868 C:Program FilesMATLABR2024abinwin64mcr.dll+00792680 mnFullExitFcn+00034808
[ 5] 0x00007ffbf21c10cd C:Program FilesMATLABR2024abinwin64mcr.dll+00790733 mnFullExitFcn+00032861
[ 6] 0x00007ffbf21bd315 C:Program FilesMATLABR2024abinwin64mcr.dll+00774933 mnFullExitFcn+00017061
[ 7] 0x00007ffbf21bed5f C:Program FilesMATLABR2024abinwin64mcr.dll+00781663 mnFullExitFcn+00023791
[ 8] 0x00007ffcb8f7e6d5 C:WINDOWSSystem32ucrtbase.dll+00517845 raise+00000485
[ 9] 0x00007ffcb8f7f6e1 C:WINDOWSSystem32ucrtbase.dll+00521953 abort+00000049
[ 10] 0x00007ffcb8f7ee19 C:WINDOWSSystem32ucrtbase.dll+00519705 terminate+00000041
[ 11] 0x00007ffcb3ea1aab C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00006827 _NLG_Return2+00002395
[ 12] 0x00007ffcb3ea2317 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00008983 _NLG_Return2+00004551
[ 13] 0x00007ffcb3ea237a C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00009082 _NLG_Return2+00004650
[ 14] 0x00007ffcb3ea4159 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00016729 _CxxFrameHandler4+00000169
[ 15] 0x00007ffcbb9549ff C:WINDOWSSYSTEM32ntdll.dll+00674303 _chkstk+00000303
[ 16] 0x00007ffcbb8ce466 C:WINDOWSSYSTEM32ntdll.dll+00124006 RtlFindCharInUnicodeString+00002710
[ 17] 0x00007ffcbb904465 C:WINDOWSSYSTEM32ntdll.dll+00345189 RtlRaiseException+00000405
[ 18] 0x00007ffcb90f543c C:WINDOWSSystem32KERNELBASE.dll+00414780 RaiseException+00000108
[ 19] 0x00007ffcb3ea2793 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00010131 _NLG_Return2+00005699
[ 20] 0x00007ffcbb954246 C:WINDOWSSYSTEM32ntdll.dll+00672326 RtlCaptureContext2+00001190
[ 21] 0x00007ffbeadd968a C:Program FilesMATLABR2024abinwin64libmwparallelplrlicensing.dll+00104074 mwboost::serialization::singleton_module::lock+00009098
[ 22] 0x00007ffbeadc4d6f C:Program FilesMATLABR2024abinwin64libmwparallelplrlicensing.dll+00019823
[ 23] 0x00007ffcb8f29333 C:WINDOWSSystem32ucrtbase.dll+00168755 recalloc+00000163
[ 24] 0x00007ffcb9f0257d C:WINDOWSSystem32KERNEL32.DLL+00075133 BaseThreadInitThunk+00000029
[ 25] 0x00007ffcbb90aa48 C:WINDOWSSYSTEM32ntdll.dll+00371272 RtlUserThreadStart+00000040
It doesn’t always happen but I’d like to know if anyone has an idea why this might be happening and if it affects the training or not.Warning: 1 worker(s) crashed while executing code in the current parallel pool. MATLAB may attempt to run the code again on the remaining workers of the pool, unless an spmd block has run. View the crash dump files to determine what caused the workers to crash.
As I have the home licenses I’m not sure what to do with the error above. The script is training a Trebagger model with parallel turned on. It does use a lot of memory but still fits within the 32GB I have. The log is :-
——————————————————————————–
abort() detected at 2024-06-09 14:55:26 +0100
——————————————————————————–
Configuration:
Crash Decoding : Disabled – No sandbox or build area path
Crash Mode : continue (default)
Default Encoding : UTF-8
Deployed : false
Graphics Driver : Uninitialized hardware
Graphics card 1 : NVIDIA ( 0x10de ) NVIDIA GeForce RTX 3060 Ti Version 32.0.15.5599 (2024-6-1)
Graphics card 2 : Intel Corporation ( 0x8086 ) Intel(R) UHD Graphics 770 Version 31.0.101.4577 (2023-7-24)
Java Version : Java 1.8.0_202-b08 with Oracle Corporation Java HotSpot(TM) 64-Bit Server VM mixed mode
MATLAB Architecture : win64
MATLAB Entitlement ID : 5834768
MATLAB Root : C:Program FilesMATLABR2024a
MATLAB Version : 24.1.0.2603908 (R2024a) Update 3
OpenGL : hardware
Operating System : Microsoft Windows 11 Home
Process ID : 24484
Processor ID : x86 Family 6 Model 151 Stepping 2, GenuineIntel
Session Key : 21d9c0b4-6172-4c58-b200-f26395bd30e7
Window System : Version 10.0 (Build 22631)
Fault Count: 1
Abnormal termination:
abort()
Current Thread: ” id 15936
Register State (captured):
RAX = 00007ffc736e7208 RBX = 00007ffc736e7208
RCX = 0000000b268f8790 RDX = 00007ffc736918f0
RSP = 0000000b268f86d0 RBP = 0000000b268f9460
RSI = 0000000000000000 RDI = 00007ffc736e7208
R8 = 0000000000000003 R9 = 0000000b268f8648
R10 = 0000000000000014 R11 = 0000000000000000
R12 = 0000000b268f9368 R13 = 0000000000000000
R14 = 00007ffc736d7138 R15 = 0000000b268f8da0
RIP = 00007ffc735d1c8a EFL = 00000202
CS = 0033 FS = 0053 GS = 002b
Stack Trace (captured):
[ 0] 0x00007ffc735cb093 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00045203 foundation::core::diag::thread_context::unspecified_bool+00000051
[ 1] 0x00007ffc735c94c8 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00038088 foundation::core::diag::stacktrace_base::capture+00000024
[ 2] 0x00007ffc735cd90f C:Program FilesMATLABR2024abinwin64libmwfl.dll+00055567 foundation::core::diag::symbols::getSymbolAddress+00009855
[ 3] 0x00007ffc735d07d7 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00067543 foundation::core::diag::is_terminate_message_enabled+00000503
[ 4] 0x00007ffbf21c1868 C:Program FilesMATLABR2024abinwin64mcr.dll+00792680 mnFullExitFcn+00034808
[ 5] 0x00007ffbf21c10cd C:Program FilesMATLABR2024abinwin64mcr.dll+00790733 mnFullExitFcn+00032861
[ 6] 0x00007ffbf21bd315 C:Program FilesMATLABR2024abinwin64mcr.dll+00774933 mnFullExitFcn+00017061
[ 7] 0x00007ffbf21bed5f C:Program FilesMATLABR2024abinwin64mcr.dll+00781663 mnFullExitFcn+00023791
[ 8] 0x00007ffcb8f7e6d5 C:WINDOWSSystem32ucrtbase.dll+00517845 raise+00000485
[ 9] 0x00007ffcb8f7f6e1 C:WINDOWSSystem32ucrtbase.dll+00521953 abort+00000049
[ 10] 0x00007ffcb8f7ee19 C:WINDOWSSystem32ucrtbase.dll+00519705 terminate+00000041
[ 11] 0x00007ffcb3ea1aab C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00006827 _NLG_Return2+00002395
[ 12] 0x00007ffcb3ea2317 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00008983 _NLG_Return2+00004551
[ 13] 0x00007ffcb3ea237a C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00009082 _NLG_Return2+00004650
[ 14] 0x00007ffcb3ea4159 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00016729 _CxxFrameHandler4+00000169
[ 15] 0x00007ffcbb9549ff C:WINDOWSSYSTEM32ntdll.dll+00674303 _chkstk+00000303
[ 16] 0x00007ffcbb8ce466 C:WINDOWSSYSTEM32ntdll.dll+00124006 RtlFindCharInUnicodeString+00002710
[ 17] 0x00007ffcbb904465 C:WINDOWSSYSTEM32ntdll.dll+00345189 RtlRaiseException+00000405
[ 18] 0x00007ffcb90f543c C:WINDOWSSystem32KERNELBASE.dll+00414780 RaiseException+00000108
[ 19] 0x00007ffcb3ea2793 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00010131 _NLG_Return2+00005699
[ 20] 0x00007ffcbb954246 C:WINDOWSSYSTEM32ntdll.dll+00672326 RtlCaptureContext2+00001190
[ 21] 0x00007ffbeadd968a C:Program FilesMATLABR2024abinwin64libmwparallelplrlicensing.dll+00104074 mwboost::serialization::singleton_module::lock+00009098
[ 22] 0x00007ffbeadc4d6f C:Program FilesMATLABR2024abinwin64libmwparallelplrlicensing.dll+00019823
[ 23] 0x00007ffcb8f29333 C:WINDOWSSystem32ucrtbase.dll+00168755 recalloc+00000163
[ 24] 0x00007ffcb9f0257d C:WINDOWSSystem32KERNEL32.DLL+00075133 BaseThreadInitThunk+00000029
[ 25] 0x00007ffcbb90aa48 C:WINDOWSSYSTEM32ntdll.dll+00371272 RtlUserThreadStart+00000040
It doesn’t always happen but I’d like to know if anyone has an idea why this might be happening and if it affects the training or not. Warning: 1 worker(s) crashed while executing code in the current parallel pool. MATLAB may attempt to run the code again on the remaining workers of the pool, unless an spmd block has run. View the crash dump files to determine what caused the workers to crash.
As I have the home licenses I’m not sure what to do with the error above. The script is training a Trebagger model with parallel turned on. It does use a lot of memory but still fits within the 32GB I have. The log is :-
——————————————————————————–
abort() detected at 2024-06-09 14:55:26 +0100
——————————————————————————–
Configuration:
Crash Decoding : Disabled – No sandbox or build area path
Crash Mode : continue (default)
Default Encoding : UTF-8
Deployed : false
Graphics Driver : Uninitialized hardware
Graphics card 1 : NVIDIA ( 0x10de ) NVIDIA GeForce RTX 3060 Ti Version 32.0.15.5599 (2024-6-1)
Graphics card 2 : Intel Corporation ( 0x8086 ) Intel(R) UHD Graphics 770 Version 31.0.101.4577 (2023-7-24)
Java Version : Java 1.8.0_202-b08 with Oracle Corporation Java HotSpot(TM) 64-Bit Server VM mixed mode
MATLAB Architecture : win64
MATLAB Entitlement ID : 5834768
MATLAB Root : C:Program FilesMATLABR2024a
MATLAB Version : 24.1.0.2603908 (R2024a) Update 3
OpenGL : hardware
Operating System : Microsoft Windows 11 Home
Process ID : 24484
Processor ID : x86 Family 6 Model 151 Stepping 2, GenuineIntel
Session Key : 21d9c0b4-6172-4c58-b200-f26395bd30e7
Window System : Version 10.0 (Build 22631)
Fault Count: 1
Abnormal termination:
abort()
Current Thread: ” id 15936
Register State (captured):
RAX = 00007ffc736e7208 RBX = 00007ffc736e7208
RCX = 0000000b268f8790 RDX = 00007ffc736918f0
RSP = 0000000b268f86d0 RBP = 0000000b268f9460
RSI = 0000000000000000 RDI = 00007ffc736e7208
R8 = 0000000000000003 R9 = 0000000b268f8648
R10 = 0000000000000014 R11 = 0000000000000000
R12 = 0000000b268f9368 R13 = 0000000000000000
R14 = 00007ffc736d7138 R15 = 0000000b268f8da0
RIP = 00007ffc735d1c8a EFL = 00000202
CS = 0033 FS = 0053 GS = 002b
Stack Trace (captured):
[ 0] 0x00007ffc735cb093 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00045203 foundation::core::diag::thread_context::unspecified_bool+00000051
[ 1] 0x00007ffc735c94c8 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00038088 foundation::core::diag::stacktrace_base::capture+00000024
[ 2] 0x00007ffc735cd90f C:Program FilesMATLABR2024abinwin64libmwfl.dll+00055567 foundation::core::diag::symbols::getSymbolAddress+00009855
[ 3] 0x00007ffc735d07d7 C:Program FilesMATLABR2024abinwin64libmwfl.dll+00067543 foundation::core::diag::is_terminate_message_enabled+00000503
[ 4] 0x00007ffbf21c1868 C:Program FilesMATLABR2024abinwin64mcr.dll+00792680 mnFullExitFcn+00034808
[ 5] 0x00007ffbf21c10cd C:Program FilesMATLABR2024abinwin64mcr.dll+00790733 mnFullExitFcn+00032861
[ 6] 0x00007ffbf21bd315 C:Program FilesMATLABR2024abinwin64mcr.dll+00774933 mnFullExitFcn+00017061
[ 7] 0x00007ffbf21bed5f C:Program FilesMATLABR2024abinwin64mcr.dll+00781663 mnFullExitFcn+00023791
[ 8] 0x00007ffcb8f7e6d5 C:WINDOWSSystem32ucrtbase.dll+00517845 raise+00000485
[ 9] 0x00007ffcb8f7f6e1 C:WINDOWSSystem32ucrtbase.dll+00521953 abort+00000049
[ 10] 0x00007ffcb8f7ee19 C:WINDOWSSystem32ucrtbase.dll+00519705 terminate+00000041
[ 11] 0x00007ffcb3ea1aab C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00006827 _NLG_Return2+00002395
[ 12] 0x00007ffcb3ea2317 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00008983 _NLG_Return2+00004551
[ 13] 0x00007ffcb3ea237a C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00009082 _NLG_Return2+00004650
[ 14] 0x00007ffcb3ea4159 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00016729 _CxxFrameHandler4+00000169
[ 15] 0x00007ffcbb9549ff C:WINDOWSSYSTEM32ntdll.dll+00674303 _chkstk+00000303
[ 16] 0x00007ffcbb8ce466 C:WINDOWSSYSTEM32ntdll.dll+00124006 RtlFindCharInUnicodeString+00002710
[ 17] 0x00007ffcbb904465 C:WINDOWSSYSTEM32ntdll.dll+00345189 RtlRaiseException+00000405
[ 18] 0x00007ffcb90f543c C:WINDOWSSystem32KERNELBASE.dll+00414780 RaiseException+00000108
[ 19] 0x00007ffcb3ea2793 C:Program FilesMATLABR2024abinwin64VCRUNTIME140_1.dll+00010131 _NLG_Return2+00005699
[ 20] 0x00007ffcbb954246 C:WINDOWSSYSTEM32ntdll.dll+00672326 RtlCaptureContext2+00001190
[ 21] 0x00007ffbeadd968a C:Program FilesMATLABR2024abinwin64libmwparallelplrlicensing.dll+00104074 mwboost::serialization::singleton_module::lock+00009098
[ 22] 0x00007ffbeadc4d6f C:Program FilesMATLABR2024abinwin64libmwparallelplrlicensing.dll+00019823
[ 23] 0x00007ffcb8f29333 C:WINDOWSSystem32ucrtbase.dll+00168755 recalloc+00000163
[ 24] 0x00007ffcb9f0257d C:WINDOWSSystem32KERNEL32.DLL+00075133 BaseThreadInitThunk+00000029
[ 25] 0x00007ffcbb90aa48 C:WINDOWSSYSTEM32ntdll.dll+00371272 RtlUserThreadStart+00000040
It doesn’t always happen but I’d like to know if anyone has an idea why this might be happening and if it affects the training or not. worker crash MATLAB Answers — New Questions