If your application crashes it will usually output a stack trace, e.g.
- 0 Foam::error::printStack(Foam::-Ostream&) in "/home/ivan/OpenFOAM/OpenFOAM-1.4.1/lib/linuxGccDPOpt/libOpenFOAM.so"
- 1 Foam::sigFpe::sigFpeHandler(int) in "/home/ivan/OpenFOAM/OpenFOAM-1.4.1/lib/linuxGccDPOpt/libOpenFOAM.so"
- 2 Uninterpreted: [0xb7f8b420]
- 3 Foam::divide(Foam::Field<double>&, Foam::UList<double> const&, Foam::UList<double> const&) in "/home/ivan/OpenFOAM/OpenFOAM-1.4.1/lib/linuxGccDPOpt/libOpenFOAM.so"
- 4 void Foam::divide<foam::fvpatchfield,>(Foam::GeometricField<double,>&, Foam::GeometricField<double,> const&, Foam::GeometricField<double,> const&) in "/home/ivan/OpenFOAM/OpenFOAM-1.4.1/lib/linuxGccDPOpt/libincompressibleTurbulenc eModels.so"
- 5 Foam::tmp<foam::geometricfield<double,> > Foam::operator/<foam::fvpatchfield,>(Foam::tmp<foam::geometricfield<double,> > const&, Foam::GeometricField<double,> const&) in "/home/ivan/OpenFOAM/OpenFOAM-1.4.1/lib/linuxGccDPOpt/libincompressibleTurbulenc eModels.so"
- 6 Foam::turbulenceModels::kEpsilon::correct() in "/home/ivan/OpenFOAM/OpenFOAM-1.4.1/lib/linuxGccDPOpt/libincompressibleTurbulenc eModels.so"
There is lots of interesting information in there. It shows the type of error (sigFpe which means a division by zero or any other operation causing an invalid floating point number) and who causes it (operator/ of an fvPatchField). Further down the line is the originator, kEpsilon::correct() which obviously does some divisions. A good guess is that one of the patch fields of k or epsilon is 0.
From experience sigfpe originate from three sources:
- as above - division by 0 from having an initial field set to 0.
- when using floatTransfer = 1. This will truncate doubles into floats before doing parallel transfer so if the double does not fit it will produce a sigfpe. Check the traceback for a call to 'compressedSend'.
- when using FOAM_SETNAN (initialises allocated memory to NaN) and accessing uninitialised memory.
The other common error is a segmentation violation (sigSegv) which is caused by an application accessing memory outside the allocated space. This are nearly always caused by a programming error.
If you want to find out more but not create a complete debugging build.
- Find out from the printed stack trace which files contain the functions that crash. Copy these into your local directory.
- Add the files to your Make/files
- in Make/options: add
-DFULLDEBUG -g -O0
to EXE_INC and recompile. The 'FULLDEBUG' causes amongst others full range checking on Lists.
In order to go step by step through the sources of the full debug objects, you'll need a debugger
Can be invoked on the command line like
Is a nice GTK+ based GUI frontend for gdb. Your solver can be launched like
nemiver xxxFoam <FoamOptions>
Is another more complex frontend for gbd. You can launch your solver with the following command
ddd --args xxxFoam <FoamOptions>
Is a bash script which can start each process of the parallel run in an extra gdb session. This script can easily extended to start a gdb frontend for each process (download patched mpirunDebug file). Once this is done you'll get a separate GUI instance for each process, where you can set breakpoints etc. separately. This behaviour is similar to Totalview. Maybe one can utilise the session features from the GUI's in order to remember e.g. breakpoints.
mpirunDebug -np 2 xxxFoam -parallel
Totalview is a commercial debugger with many features. It can debug your application in parallel out of the box.
gdb seems to have problems to step into expressions like
4 Additional Info
Sometimes it might be helpful to set an endless loop somewhere into solver, and change the variable inside the debugger after launching
int myi = 0; while (0 == myi) Foam::sleep(5);