Overview<\/h2>\n\n\n
Crash dumping system facilitates service providers or developers to collect crashes happened in the set-top boxes and do the debugging in offline. Crash dumping system is a debug supporting system, which consists of Crash dumping server(s) with user interfaces. Crash dumping server collect crash logs which happened in the connected STBs, process these logs and store for future reference.<\/p>\n
Crash log is a log file automatically created on Set top boxes when a crash occurs. This information is useful for offline debugging. <\/p>\n\n\n
Minidump<\/span><\/h2>\n\n\n\n- A list of the executable and shared libraries that were loaded in the process at the time the dump was created. This list includes both file names and identifiers for the particular versions of those files that were loaded.<\/li>\n
- A list of threads present in the process. For each thread, the minidump includes the state of the processor registers, and the contents of the threads’ stack memory.<\/li>\n
- Other information about the system on which the dump was collected: processor and operating system versions, the reason for the dump, and so on.\u00a0<\/li>\n<\/ul>\n
Google Breakpad<\/p>\n
Breakpad is a library that records crashes in compact “minidump” files. It \u00a0produce C and C++ stack traces from minidumps. Breakpad can also write minidumps on request for programs that have not crashed.\u00a0<\/p>\n
\u00a0\u00a0<\/p>\n
![](\"\/wp-content\/uploads\/sites\/16\/2023\/09\/crashupload.drawio.png\")
<\/p>\n
How to Integrate Google Breakpad library<\/strong>?<\/strong><\/p>\n\n- \n
Link against libbreakpad_client library.<\/p>\n<\/li>\n
- \n
#include “client\/linux\/handler\/exception_handler.h\u201c<\/p>\n<\/li>\n
- Instantiate an ExceptionHandler object, ExceptionHandler constructor requires a path where it can write minidumps, as well as a callback function to receive information about minidumps that were written.<\/li>\n<\/ul>\n
\u00a0 \u00a0 \u00a0<\/p>\n
\n\n#include \"client\/linux\/handler\/exception_handler.h\u201c \/\/ Include Header file for exception handler\nstatic bool dumpCallback(const google_breakpad::MinidumpDescriptor& descriptor, void* context, bool succeeded)\n{\n\u00a0 printf(\"Dump path: %sn\", descriptor.path());\n\u00a0 return succeeded;\n}\n\nint main(int argc, char* argv[])\n{\n\u00a0 google_breakpad::MinidumpDescriptor descriptor(\"\/tmp\"); \n\u00a0 google_breakpad::ExceptionHandler eh(descriptor, \/\/ Minidump will be saved in \/tmp\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0dumpCallback, \/\/Callback\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0true,\n<\/pre>\n<\/div>\n<\/div>\nGoogle Breakpad Utilities<\/strong><\/p>\n\n- dump_syms is used for symbol extraction.<\/li>\n<\/ul>\n\ndump_syms .\/gpsample_app > gpsample_app.sym, will generate symbol file.<\/div>\n<\/div>\n
\n- minidump_stackwalk is used for \u00a0symbolized stack trace\u00a0<\/li>\n<\/ul>\n\n\n
It takes a minidump and its corresponding text-format symbols and produce a symbolized stacktrace.<\/p>\n
minidump_stackwalk minidump.dmp gpsample_app.sym<\/p>\n<\/div>\n<\/div>\n
uploadDumps.sh collects core dumps\/ mini dumps \u00a0to crash server whenever any applications crashes.<\/p>\n
Sample Application<\/strong><\/p>\n\n\n#include \"client\/linux\/handler\/exception_handler.h\u201c\nstatic bool dumpCallback(const google_breakpad::MinidumpDescriptor& descriptor,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0void* context,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0bool succeeded)\n{\n\u00a0 printf(\"Dump path: %sn\", descriptor.path());\n\u00a0 return succeeded;\n}\n\nvoid crash()\n{\n\u00a0 volatile int* a = (int*)(NULL);\n\u00a0 *a = 1;\n}\n\n\nint main(int argc, char* argv[])\n{\n\u00a0 google_breakpad::MinidumpDescriptor descriptor(\"\/tmp\");\n\u00a0 google_breakpad::ExceptionHandler eh(descriptor,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0dumpCallback,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0true,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0-1);\n\u00a0 crash();\n\u00a0 return 0;\n}\n<\/pre>\n<\/div>\n<\/div>\nTo compile the source <\/u><\/p>\n\n- Create a simple Makefile<\/li>\n
- Add the following contents to the Makefile<\/li>\n<\/ul>\n\n\n
PKG_CONFIG_PATH=..\/<\/p>\n
all: breakpad_exercise.c<\/p>\n
@ $(CXX) -std=c++11 breakpad_exercise.c -g -o breakpad_exercise `pkg-config –cflags breakpad` -L.\/client\/linux\/ -lbreakpad_client -I.\/ -lpthread<\/p>\n<\/div>\n<\/div>\n
\n- make\u00a0<\/li>\n<\/ul>\n
Execute the sample application<\/u><\/p>\n\n- An application of name \u201cbreakpad_exercise\u201d will be generated. Copy this executable to the box\u00a0<\/li>\n
- Run the application in the box which will cause segmentation fault:\n
root@raspberrypi-rdk-hybrid:~# ls\nbreakpad_exercise\nroot@raspberrypi-rdk-hybrid:~# .\/breakpad_exercise\nCrash occured, Callback function called.\nSegmentation fault (core dumped)\nroot@raspberrypi-rdk-hybrid:~# <\/pre>\n<\/li>\n
- A minidump will be generated in the same file\n
root@raspberrypi-rdk-hybrid:~# ls\n40e9abf8-19cc-4b55-cd2bb29f-dbd37900.dmp breakpad_exercise\nroot@raspberrypi-rdk-hybrid:~#<\/pre>\n<\/li>\n<\/ul>\n\n\nCoredump<\/h2>\n\n\n
Core dump files generated after an uncaught signal in a process (as a SIGSEGV or SIGQUIT), are generated in the base directory where the program was executed, and the core dumps starts with the name as “core” or “<\/span>core.PID<\/span>”.<\/span><\/p>\nBy default size of the core will be zero, To generate the core, we need to set the size of the core to unlimited. <\/p>\n
\n- ulimit -c unlimited<\/strong><\/li>\n<\/ul>\n
By default, core will be generated in the current directory with the file name “core<\/strong>“. We can change the core generating directory from current directory to another by editing the kernel configuration file core pattern(\/proc\/sys\/kernel\/core_pattern) <\/strong><\/strong> in the kernel.<\/p>\n\n- \n
echo “newpattern” > \/proc\/sys\/kernel\/core_pattern<\/strong><\/p>\n<\/li>\n<\/ul>\nCore pattern is helpful in the case if there are couple of core dumps files in one directory and we don’t know which program caused it.<\/span><\/p>\nHow to get stack trace?<\/span><\/strong><\/p>\nMake sue the executable is compiled with -g option to turn on the debugging symbols<\/span><\/p>\n
Google Breakpad<\/p>\n
Breakpad is a library that records crashes in compact “minidump” files. It \u00a0produce C and C++ stack traces from minidumps. Breakpad can also write minidumps on request for programs that have not crashed.\u00a0<\/p>\n
\u00a0\u00a0<\/p>\n
<\/p>\n
How to Integrate Google Breakpad library<\/strong>?<\/strong><\/p>\n Link against libbreakpad_client library.<\/p>\n<\/li>\n #include “client\/linux\/handler\/exception_handler.h\u201c<\/p>\n<\/li>\n \u00a0 \u00a0 \u00a0<\/p>\n Google Breakpad Utilities<\/strong><\/p>\n It takes a minidump and its corresponding text-format symbols and produce a symbolized stacktrace.<\/p>\n minidump_stackwalk minidump.dmp gpsample_app.sym<\/p>\n<\/div>\n<\/div>\n uploadDumps.sh collects core dumps\/ mini dumps \u00a0to crash server whenever any applications crashes.<\/p>\n Sample Application<\/strong><\/p>\n To compile the source <\/u><\/p>\n PKG_CONFIG_PATH=..\/<\/p>\n all: breakpad_exercise.c<\/p>\n @ $(CXX) -std=c++11 breakpad_exercise.c -g -o breakpad_exercise `pkg-config –cflags breakpad` -L.\/client\/linux\/ -lbreakpad_client -I.\/ -lpthread<\/p>\n<\/div>\n<\/div>\n Execute the sample application<\/u><\/p>\n Core dump files generated after an uncaught signal in a process (as a SIGSEGV or SIGQUIT), are generated in the base directory where the program was executed, and the core dumps starts with the name as “core” or “<\/span>core.PID<\/span>”.<\/span><\/p>\n By default size of the core will be zero, To generate the core, we need to set the size of the core to unlimited. <\/p>\n By default, core will be generated in the current directory with the file name “core<\/strong>“. We can change the core generating directory from current directory to another by editing the kernel configuration file core pattern(\/proc\/sys\/kernel\/core_pattern) <\/strong><\/strong> in the kernel.<\/p>\n echo “newpattern” > \/proc\/sys\/kernel\/core_pattern<\/strong><\/p>\n<\/li>\n<\/ul>\n Core pattern is helpful in the case if there are couple of core dumps files in one directory and we don’t know which program caused it.<\/span><\/p>\n How to get stack trace?<\/span><\/strong><\/p>\n Make sue the executable is compiled with -g option to turn on the debugging symbols<\/span><\/p>\n\n
#include \"client\/linux\/handler\/exception_handler.h\u201c \/\/ Include Header file for exception handler\nstatic bool dumpCallback(const google_breakpad::MinidumpDescriptor& descriptor, void* context, bool succeeded)\n{\n\u00a0 printf(\"Dump path: %sn\", descriptor.path());\n\u00a0 return succeeded;\n}\n\nint main(int argc, char* argv[])\n{\n\u00a0 google_breakpad::MinidumpDescriptor descriptor(\"\/tmp\"); \n\u00a0 google_breakpad::ExceptionHandler eh(descriptor, \/\/ Minidump will be saved in \/tmp\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0dumpCallback, \/\/Callback\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0true,\n<\/pre>\n<\/div>\n<\/div>\n\n
\n
#include \"client\/linux\/handler\/exception_handler.h\u201c\nstatic bool dumpCallback(const google_breakpad::MinidumpDescriptor& descriptor,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0void* context,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0bool succeeded)\n{\n\u00a0 printf(\"Dump path: %sn\", descriptor.path());\n\u00a0 return succeeded;\n}\n\nvoid crash()\n{\n\u00a0 volatile int* a = (int*)(NULL);\n\u00a0 *a = 1;\n}\n\n\nint main(int argc, char* argv[])\n{\n\u00a0 google_breakpad::MinidumpDescriptor descriptor(\"\/tmp\");\n\u00a0 google_breakpad::ExceptionHandler eh(descriptor,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0dumpCallback,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0NULL,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0true,\n\u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0 \u00a0-1);\n\u00a0 crash();\n\u00a0 return 0;\n}\n<\/pre>\n<\/div>\n<\/div>\n\n
\n
\n
root@raspberrypi-rdk-hybrid:~# ls\nbreakpad_exercise\nroot@raspberrypi-rdk-hybrid:~# .\/breakpad_exercise\nCrash occured, Callback function called.\nSegmentation fault (core dumped)\nroot@raspberrypi-rdk-hybrid:~# <\/pre>\n<\/li>\n
root@raspberrypi-rdk-hybrid:~# ls\n40e9abf8-19cc-4b55-cd2bb29f-dbd37900.dmp breakpad_exercise\nroot@raspberrypi-rdk-hybrid:~#<\/pre>\n<\/li>\n<\/ul>\n\n\n
Coredump<\/h2>\n\n\n
\n
\n