From: Christian Babeux Date: Fri, 19 Jul 2013 20:12:49 +0000 (-0400) Subject: Add core dump snapshot handler script X-Git-Tag: v2.3.0-rc2~5 X-Git-Url: https://git.lttng.org./?a=commitdiff_plain;h=57f0bd0c140c6a5b1f48b45a6680c55348ddbe96;p=lttng-tools.git Add core dump snapshot handler script This is a custom core dump program that will be called when a core dump occurs. The program will save the core data in CORE_PATH and also, if a root session daemon is running, will record a snapshot of tracing data using the lttng command line utility. Refer to README for installation and testing instructions. Sample output of test script: Setup... Spawning a session daemon Session auto-20130626-224838 created. Kernel channel chan enabled for session auto-20130626-224838 kernel event sched_switch created in channel chan Tracing started for session auto-20130626-224838 Sleeping... Crashing... ./test.sh: line 35: 16980 Segmentation fault (core dumped) $(dirname $0)/crash Waiting for data availability Tracing stopped for session auto-20130626-224838 Session auto-20130626-224838 destroyed Core dump and snapshot will be available in /tmp/lttng/{core,snapshot}. /tmp/lttng |-- core | `-- core.16980 `-- snapshot `-- snapshot |-- chan_0 |-- chan_1 |-- chan_2 |-- chan_3 |-- chan_4 |-- chan_5 |-- chan_6 |-- chan_7 `-- metadata Signed-off-by: Christian Babeux Signed-off-by: Mathieu Desnoyers --- diff --git a/configure.ac b/configure.ac index f4a3cd894..1a9e42d56 100644 --- a/configure.ac +++ b/configure.ac @@ -322,6 +322,7 @@ AC_CONFIG_FILES([ extras/bindings/Makefile extras/bindings/swig/Makefile extras/bindings/swig/python/Makefile + extras/core-handler/Makefile src/Makefile src/common/Makefile src/common/kernel-ctl/Makefile diff --git a/extras/Makefile.am b/extras/Makefile.am index 925dc2eb9..52de61821 100644 --- a/extras/Makefile.am +++ b/extras/Makefile.am @@ -1 +1 @@ -SUBDIRS = bindings +SUBDIRS = bindings core-handler diff --git a/extras/core-handler/Makefile.am b/extras/core-handler/Makefile.am new file mode 100644 index 000000000..eff5443a3 --- /dev/null +++ b/extras/core-handler/Makefile.am @@ -0,0 +1,8 @@ +AM_CFLAGS = -O2 -g +AM_LDFLAGS = + +noinst_PROGRAMS = crash +crash_SOURCES = crash.c + +noinst_SCRIPTS = handler.sh install.sh test.sh +EXTRA_DIST = handler.sh install.sh test.sh diff --git a/extras/core-handler/README b/extras/core-handler/README new file mode 100644 index 000000000..4482fd15b --- /dev/null +++ b/extras/core-handler/README @@ -0,0 +1,79 @@ +LTTng core dump snapshot handler +Christian Babeux, June 2013 + +This is a custom core dump program that will be called when a core dump +occurs. The program will save the core data in CORE_PATH and also, if a +root session daemon is running, will record a snapshot of tracing data +using the lttng command line utility. + +The core dump snapshot handler can be installed by using the provided +install.sh script or by adding the appropriate program pipe line to +/proc/sys/kernel/core_pattern. Refer to core(5) for more information +about the Linux kernel core dump handling and custom handler mechanism. + +Installation: + +# ./install.sh +Backup current core_pattern in core_pattern.bkp. +Successfully installed core_pattern. + +How to use: + +You can use the provided test.sh script to test that the core dump snapshot +handler is working properly: + +# ./test.sh +Setup... +Spawning a session daemon +Session auto-20130626-224838 created. +Kernel channel chan enabled for session auto-20130626-224838 +kernel event sched_switch created in channel chan +Tracing started for session auto-20130626-224838 +Sleeping... +Crashing... +./test.sh: line 35: 16980 Segmentation fault (core dumped) +$(dirname $0)/crash +Waiting for data availability +Tracing stopped for session auto-20130626-224838 +Session auto-20130626-224838 destroyed +Core dump and snapshot will be available in /tmp/lttng/{core,snapshot}. + +# tree /tmp/lttng +/tmp/lttng +|-- core +| `-- core.16980 +`-- snapshot + `-- snapshot + |-- chan_0 + |-- chan_1 + |-- chan_2 + |-- chan_3 + |-- chan_4 + |-- chan_5 + |-- chan_6 + |-- chan_7 + `-- metadata + +Chaining with other core dump handler: + +Some Linux distributions already use their own core dump handler +(such as systemd 'systemd-coredump' utility). It is possible to chain these +core dump utility with the core dump snapshot handler. In order to achieve +this, the core dump snapshot handler must be first in the chain (e.g. +installed in /proc/sys/kernel/core_pattern) and the other core dump +handler must be called from within the core dump snapshot handler script. + +Example (chaining with systemd systemd-coredump): + +# cat /proc/sys/kernel/core_pattern +|/path/to/lttng/handler.sh %p %u %g %s %t %h %e %E %c + +In LTTng handler.sh script: + +[...] +# Save core dump from stdin. +$MKDIR_BIN -p "${CORE_PATH}" + +# Optional, chain core dump handler with original systemd script. +$CAT_BIN - | /usr/lib/systemd/systemd-coredump $p $u $g $s $t $e +[...] diff --git a/extras/core-handler/crash.c b/extras/core-handler/crash.c new file mode 100644 index 000000000..2b9cf4a72 --- /dev/null +++ b/extras/core-handler/crash.c @@ -0,0 +1,25 @@ +/* + * Copyright (C) 2013 - Christian Babeux + * + * This program is free software; you can redistribute it and/or modify + * it under the terms of the GNU General Public License, version 2 only, + * as published by the Free Software Foundation. + * + * This program is distributed in the hope that it will be useful, but WITHOUT + * ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or + * FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for + * more details. + * + * You should have received a copy of the GNU General Public License along + * with this program; if not, write to the Free Software Foundation, Inc., + * 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA. + */ + + +#include + +int main(int argc, char *argv[]) +{ + raise(SIGSEGV); + return 0; +} diff --git a/extras/core-handler/handler.sh b/extras/core-handler/handler.sh new file mode 100755 index 000000000..3026e52f9 --- /dev/null +++ b/extras/core-handler/handler.sh @@ -0,0 +1,72 @@ +#!/bin/sh +# +# Copyright (C) 2013 - Christian Babeux +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; only version 2 +# of the License. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA. +# + +# System binaries paths. +CAT_BIN="cat" +PGREP_BIN="pgrep" +MKDIR_BIN="mkdir" +LTTNG_BIN="lttng" + +# Core file settings. +CORE_PATH="/tmp/lttng/core" +CORE_PREFIX="core" + +# Folder where to save snapshot output. +# Can also be a remote URI. +SNAPSHOT_PATH="/tmp/lttng/snapshot" +SNAPSHOT_OUTPUT="file://${SNAPSHOT_PATH}" + +# Sessiond binary name. +SESSIOND_BIN_NAME="lttng-sessiond" + +# Core specifiers, see man core(5) + +p=$1 # PID of dumped process +u=$2 # (numeric) real UID of dumped process +g=$3 # (numeric) real GID of dumped process +s=$4 # number of signal causing dump +t=$5 # time of dump, expressed as seconds since the Epoch, + # 1970-01-01 00:00:00 +0000 (UTC) +h=$6 # hostname (same as nodename returned by uname(2)) +e=$7 # executable filename (without path prefix) +E=$8 # pathname of executable, with slashes ('/') replaced + # by exclamation marks ('!'). +c=$9 # core file size soft resource limit of crashing process + # (since Linux 2.6.24) + +# Save core dump from stdin. +$MKDIR_BIN -p "${CORE_PATH}" +$CAT_BIN - > "${CORE_PATH}/${CORE_PREFIX}.$p" + +# Optional, chain core dump handler with original systemd script. +#$CAT_BIN - | /usr/lib/systemd/systemd-coredump $p $u $g $s $t $e + +# TODO: Checking for a sessiond lockfile would be more appropriate. +if $PGREP_BIN -u root "${SESSIOND_BIN_NAME}" > /dev/null 2>&1 +then + # Since we are called via the kernel coredump mechanism, we need to + # setup our environment manually. + # + # The lttng command line tool lookup $HOME to adjust the .lttngrc + # path. This is useful to have automatic session name lookup. + export HOME="/root" + $MKDIR_BIN -p "${SNAPSHOT_PATH}" + $LTTNG_BIN snapshot add-output "${SNAPSHOT_OUTPUT}" > /dev/null 2>&1 + $LTTNG_BIN snapshot record > /dev/null 2>&1 +fi diff --git a/extras/core-handler/install.sh b/extras/core-handler/install.sh new file mode 100755 index 000000000..4e8d8443f --- /dev/null +++ b/extras/core-handler/install.sh @@ -0,0 +1,34 @@ +#!/bin/sh +# +# Copyright (C) 2013 - Christian Babeux +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; only version 2 +# of the License. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA. +# + +CORE_PATTERN="/proc/sys/kernel/core_pattern" +CORE_HANDLER_PATH="$(dirname $(readlink -e $0))/handler.sh" + +cat ${CORE_PATTERN} > core_pattern.bkp + +echo "Backup current core_pattern in core_pattern.bkp." + +echo "|$CORE_HANDLER_PATH %p %u %g %s %t %h %e %E %c" > ${CORE_PATTERN} + +if [ $? -eq 0 ] +then + echo "Successfully installed core_pattern." +else + echo "Installation of core_pattern failed." +fi diff --git a/extras/core-handler/test.sh b/extras/core-handler/test.sh new file mode 100755 index 000000000..0c04bcd97 --- /dev/null +++ b/extras/core-handler/test.sh @@ -0,0 +1,43 @@ +#!/bin/sh +# +# Copyright (C) 2013 - Christian Babeux +# +# This program is free software; you can redistribute it and/or +# modify it under the terms of the GNU General Public License +# as published by the Free Software Foundation; only version 2 +# of the License. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111-1307, USA. +# + +LTTNG_BIN="lttng" + +CHANNEL_NAME="chan" +EVENT_NAME="sched_switch" + +echo "Setup..." +$LTTNG_BIN create --no-output +$LTTNG_BIN enable-channel "${CHANNEL_NAME}" -k --overwrite --output mmap +$LTTNG_BIN enable-event "${EVENT_NAME}" -c "${CHANNEL_NAME}" -k +$LTTNG_BIN start + +echo "Sleeping..." +sleep 10 + +echo "Crashing..." +$(dirname $0)/crash + +echo "Sleeping..." +sleep 10 + +$LTTNG_BIN stop +$LTTNG_BIN destroy + +echo "Core dump and snapshot will be available in /tmp/lttng/{core,snapshot}."