/ troubleshooting

Fix AutoGluon Segment Fault

Issue

When running AutoGluon, especially predictor.leaderboard(test), you may encounter this error message:

BLAS : Program is Terminated. Because you tried to allocate too many memory regions.
Segmentation fault (core dumped)BLAS : Program is Terminated. Because you tried to allocate too many memory regions.
Segmentation fault (core dumped)

or, if you are runing inside JupyterLab:

The kernel for xxx.ipynb appears to have died.

Analysis

This seems more possible happen on multi-core cpu machine, e.g. Mine was 128-core.
The reason is likely related to multi-thread, as indicated in (this discussion)[https://github.com/awslabs/autogluon/issues/1020], there might be a conflict between 2 different multi threading machenism.

Solution

As suggested by awethaileslassie: You need to run the followings on the command line and it should fix the error:

export OPENBLAS_NUM_THREADS=1
export GOTO_NUM_THREADS=1
export OMP_NUM_THREADS=1
Fix AutoGluon Segment Fault
Share this