# dumpadm Dump content: kernel pages Dump device: /dev/zvol/dsk/rpool/dump (dedicated) Savecore directory: /var/crash/parity Savecore enabled: yes Save compressed: on So savecore is enabled. # reboot -d Console: May 22 18:02:24 parity savecore: Decompress the crash dump with May 22 18:02:24 parity 'savecore -vf /var/crash/parity/vmdump.0' SUNW-MSG-ID: SUNOS-8000-KL, TYPE: Defect, VER: 1, SEVERITY: Major EVENT-TIME: Sat May 22 18:02:24 PDT 2010 PLATFORM: Sun-Fire-V40z, CSN: XG051535088, HOSTNAME: parity SOURCE: software-diagnosis, REV: 0.1 EVENT-ID: 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 DESC: The system has rebooted after a kernel panic. Refer to http://sun.com/msg/SUNOS-8000-KL for more information. AUTO-RESPONSE: The failed system image was dumped to the dump device. If savecore is enabled (see dumpadm(1M)) a copy of the dump will be written to the savecore directory . IMPACT: There may be some performance impact while the panic is copied to the savecore directory. Disk space usage by panics can be substantial. REC-ACTION: Please log a call with you support vendor and provide them with this information. If savecore is not enabled then please take steps to preserve the crash image. The diagnosis comes after the savecore has run to completion. # fmadm faulty --------------- ------------------------------------ -------------- --------- TIME EVENT-ID MSG-ID SEVERITY --------------- ------------------------------------ -------------- --------- May 22 18:02:24 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 SUNOS-8000-KL Major Host : parity Platform : Sun-Fire-V40z Chassis_id : XG051535088 Product_sn : Fault class : defect.sunos.kernel.panic Affects : sw:///:path=/var/crash/parity/.98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 faulted but still in service Problem in : sw:///:path=/var/crash/parity/.98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 faulted but still in service Description : The system has rebooted after a kernel panic. Refer to http://sun.com/msg/SUNOS-8000-KL for more information. Response : The failed system image was dumped to the dump device. If savecore is enabled (see dumpadm(1M)) a copy of the dump will be written to the savecore directory . Impact : There may be some performance impact while the panic is copied to the savecore directory. Disk space usage by panics can be substantial. Action : Please log a call with you support vendor and provide them with this information. If savecore is not enabled then please take steps to preserve the crash image. Email: Date: Sat, 22 May 2010 18:02:24 -0700 (PDT) From: No Access User Message-Id: <201005230102.o4N12O8E100786@parity.sfbay.sun.com> X-FMEV-HOSTNAME: parity X-FMEV-CLASS: list.suspect X-FMEV-UUID: 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 X-FMEV-CODE: SUNOS-8000-KL X-FMEV-SEVERITY: Major Reply-To: root@parity.sfbay.sun.com Subject: Fault Management Event: parity:SUNOS-8000-KL X-Source-IP: parity.SFBay.Sun.COM [10.4.193.172] X-Auth-Type: Internal IP X-CT-RefId: str=0001.0A090202.4BF87F3A.007E,ss=1,fgs=0 SUNW-MSG-ID: SUNOS-8000-KL, TYPE: Defect, VER: 1, SEVERITY: Major EVENT-TIME: 20 PLATFORM: Sun-Fire-V40z, CSN: XG051535088, HOSTNAME: parity SOURCE: software-diagnosis, REV: 0.1 EVENT-ID: 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 DESC: The system has rebooted after a kernel panic. Refer to http://sun.com/msg/SUNOS-8000-KL for more information. AUTO-RESPONSE: The failed system image was dumped to the dump device. If savecore is enabled (see dumpadm(1M)) a copy of the dump will be written to the savecore directory . IMPACT: There may be some performance impact while the panic is copied to the savecore directory. Disk space usage by panics can be substantial. REC-ACTION: Please log a call with you support vendor and provide them with this information. If savecore is not enabled then please take steps to preserve the crash image. The list.suspect in full: TIME UUID SUNW-MSG-ID May 22 2010 18:02:24.848189000 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 SUNOS-8000-KL TIME CLASS ENA May 22 18:02:24.7841 ireport.os.sunos.panic.dump_available 0x0000000000000000 May 22 18:01:30.4486 ireport.os.sunos.panic.dump_pending_on_device 0x0000000000000000 nvlist version: 0 version = 0x0 class = list.suspect uuid = 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 code = SUNOS-8000-KL diag-time = 1274576544 800599 de = fmd:///module/software-diagnosis fault-list-sz = 0x1 fault-list = (array of embedded nvlists) (start fault-list[0]) nvlist version: 0 version = 0x0 class = defect.sunos.kernel.panic certainty = 0x64 asru = sw:///:path=/var/crash/parity/.98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 resource = sw:///:path=/var/crash/parity/.98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 savecore-succcess = 1 dump-dir = /var/crash/parity dump-files = vmdump.0 os-instance-uuid = 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 panicstr = forced crash dump initiated at user request panicstack = genunix:kadmin+16e () | genunix:uadmin+10f () | unix:brand_sys_syscall32+272 () | crashtime = 1274576428 panic-time = Sat May 22 18:00:28 2010 PDT (end fault-list[0]) fault-status = 0x1 severity = Major __ttl = 0x1 __tod = 0x4bf87ea0 0x328e5648 And the telemetry events: # fmdump -IVp -c 'ireport.os.sunos.*' TIME UUID May 22 2010 18:01:30.448603275 128298c9-f7b0-e05a-e3e3-bbcfce527399 nvlist version: 0 version = 0x0 class = ireport.os.sunos.panic.dump_pending_on_device uuid = 128298c9-f7b0-e05a-e3e3-bbcfce527399 detector = sw:///:path=/usr/bin/amd64/savecore#:file=../savecore.c:func=raise_event:line=1603 pri = high attr = (embedded nvlist) nvlist version: 0 dumpdir = /var/crash/parity savecore-enabled = 1 os-instance-uuid = 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 crashtime = 1274576428 panicstr = forced crash dump initiated at user request panicstack = genunix:kadmin+16e () | genunix:uadmin+10f () | unix:brand_sys_syscall32+272 () | fm-panic = 0 will-attempt-savecore = 1 panic-time = Sat May 22 18:00:28 2010 PDT (end attr) __ttl = 0x1 __tod = 0x4bf87e6a 0x1abd248b May 22 2010 18:02:24.784190624 125f05a9-dfb6-ee01-f70a-e1bc7bf2f1b9 nvlist version: 0 version = 0x0 class = ireport.os.sunos.panic.dump_available uuid = 125f05a9-dfb6-ee01-f70a-e1bc7bf2f1b9 detector = sw:///:path=/usr/bin/amd64/savecore#:file=../savecore.c:func=raise_event:line=1603 pri = high attr = (embedded nvlist) nvlist version: 0 dumpdir = /var/crash/parity instance = 0 compressed = 1 os-instance-uuid = 98e5d85e-1c7f-e75b-d8eb-8bc167f2d844 crashtime = 1274576428 panicstr = forced crash dump initiated at user request panicstack = genunix:kadmin+16e () | genunix:uadmin+10f () | unix:brand_sys_syscall32+272 () | fm-panic = 0 panic-time = Sat May 22 18:00:28 2010 PDT (end attr) __ttl = 0x1 __tod = 0x4bf87ea0 0x2ebdcca0