From Nicolas.Williams@sun.com Tue Sep 15 17:11:47 2009 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n8G0BkgA015634 for ; Tue, 15 Sep 2009 17:11:46 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n8G0BcN7005879; Wed, 16 Sep 2009 01:11:45 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KQ100C0HF7I7H00@brm-avmta-1.central.sun.com>; Tue, 15 Sep 2009 18:11:42 -0600 (MDT) Received: from binky.Central.Sun.COM ([129.153.128.104]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KQ1002BCF7IBV30@brm-avmta-1.central.sun.com>; Tue, 15 Sep 2009 18:11:42 -0600 (MDT) Received: from binky.Central.Sun.COM (localhost [127.0.0.1]) by binky.Central.Sun.COM (8.14.3+Sun/8.14.3) with ESMTP id n8G089ad018197; Tue, 15 Sep 2009 19:08:09 -0500 (CDT) Received: (from nw141292@localhost) by binky.Central.Sun.COM (8.14.3+Sun/8.14.3/Submit) id n8G0894n018196; Tue, 15 Sep 2009 19:08:09 -0500 (CDT) Date: Tue, 15 Sep 2009 19:08:09 -0500 From: Nicolas Williams Subject: Re: zstreamdump [PSARC/2009/491 Self Review] In-reply-to: <200909160006.n8G06Ds4001856@spidey.local> To: Tim Haley Cc: PSARC-ext@sun.com, zfs-team@sun.com Message-id: <20090916000808.GK1033@Sun.COM> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Content-disposition: inline X-PMX-Version: 5.4.1.325704 References: <200909160006.n8G06Ds4001856@spidey.local> X-Authentication-warning: binky.Central.Sun.COM: nw141292 set sender to Nicolas.Williams@sun.com using -f User-Agent: Mutt/1.5.7i Status: RO Content-Length: 1091 On Tue, Sep 15, 2009 at 06:06:13PM -0600, Tim Haley wrote: > NAME > zstreamdump - dump the metadata in a ZFS send stream > > SYNOPSIS > zstreamdump [-vC] > > DESCRIPTION > The zstreamdump command reads a ZFS send stream from stdin and > prints out selected fields from the metadata to stdout. By > default, it also validates the checksums for each of the dataset > streams embedded in the overall send stream. A summary of the > stream contents is printed at the end. > > OPTIONS > The following options are supported: > > -v Verbose mode. All records are dumped. Default is to > only dump the metadata from the BEGIN and END records. > > -C Suppress the validation of checksums. Causes the tool to > run faster. It'd be nice if zfs recv could do this too, no? Alternatively, it'd be nice if there was a way to slot zstreamdump into a zfs send | ... | zfs recv pipe. E.g., an option to zstreamdump to send its output to a file or to stderr, passing the stream through to stdout for piping elsewhere. Nico -- From Tim.Haley@sun.com Tue Sep 15 17:13:47 2009 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n8G0Dkf5015687 for ; Tue, 15 Sep 2009 17:13:46 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id n8G0DiUb014097; Wed, 16 Sep 2009 08:13:45 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KQ100901FAWBV00@nwk-avmta-2.sfbay.sun.com>; Tue, 15 Sep 2009 17:13:44 -0700 (PDT) Received: from dm-central-02.central.sun.com ([129.147.62.5]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KQ100LRBFAVR6E0@nwk-avmta-2.sfbay.sun.com>; Tue, 15 Sep 2009 17:13:43 -0700 (PDT) Received: from spidey.local (spidey.Central.Sun.COM [172.20.25.27]) by dm-central-02.central.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n8G0Dhi1013435; Tue, 15 Sep 2009 18:13:43 -0600 (MDT) Received: from spidey.local (localhost [127.0.0.1]) by spidey.local (8.14.3+Sun/8.14.3) with ESMTP id n8G06DXu001857; Tue, 15 Sep 2009 18:06:13 -0600 (MDT) Received: (from timh@localhost) by spidey.local (8.14.3+Sun/8.14.3/Submit) id n8G06Ds4001856; Tue, 15 Sep 2009 18:06:13 -0600 (MDT) Date: Tue, 15 Sep 2009 18:06:13 -0600 (MDT) From: Tim Haley Subject: zstreamdump [PSARC/2009/491 Self Review] To: PSARC-ext@sun.com Cc: zfs-team@sun.com Message-id: <200909160006.n8G06Ds4001856@spidey.local> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 3062 I am sponsoring the following case for Lori Alt. Requested binding is micro/patch. The case introduces a new command, zstreamdump, which is used to dump the metadata in a zfs send stream (i.e., the output of a 'zfs send' command). It will also verify the checksums in the send stream. Given the straight-forwardness of the case I believe it qualifies for self-review. If others disagree, let me know and I'll convert it to a fast-track. Template Version: @(#)sac_nextcase 1.68 02/23/09 SMI This information is Copyright 2009 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: zstreamdump - send stream dumping utility 1.2. Name of Document Author/Supplier: Author: Lori Alt 1.3 Date of This Document: 15 September, 2009 4. Technical Description OVERVIEW: It is often useful for debugging purposes to examine the record headers in a zfs send stream. This tool will also identify most cases of send stream corruption, by verifying the correctness of the record headers and checksumming the stream contents. PROPOSED SOLUTION: A new tool, zstreamdump, is proposed for this purpose. The utility reads a send stream from stdin and prints some of the metadata from each record header (more is printed in verbose mode) to stdout. If the -C option is not specified, the checksum of each embedded dataset stream is verified. The draft man page for this tool is supplied below. DRAFT MAN PAGE System Administration Commands zstreamdump(1M) NAME zstreamdump - dump the metadata in a ZFS send stream SYNOPSIS zstreamdump [-vC] DESCRIPTION The zstreamdump command reads a ZFS send stream from stdin and prints out selected fields from the metadata to stdout. By default, it also validates the checksums for each of the dataset streams embedded in the overall send stream. A summary of the stream contents is printed at the end. OPTIONS The following options are supported: -v Verbose mode. All records are dumped. Default is to only dump the metadata from the BEGIN and END records. -C Suppress the validation of checksums. Causes the tool to run faster. EXIT STATUS The following exit values are returned: 0 The stream is consistent. 1 An error was detected. ATTRIBUTES See attributes(5) for descriptions of the following attributes: ____________________________________________________________ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | |_____________________________|_____________________________| | Availability | SUNWzfsu | |_____________________________|_____________________________| | Interface Stability | Uncommitted | |_____________________________|_____________________________| 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: ON 6.5. ARC review type: Automatic 6.6. ARC Exposure: open From Joerg.Schilling9ab33xy531fokus.fraunhofer.de@bounce.antispameurope.com Wed Sep 16 05:52:15 2009 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n8GCqC6j011041 for ; Wed, 16 Sep 2009 05:52:13 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n8GCpxrM003092 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Wed, 16 Sep 2009 13:52:11 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KQ200203EEYJI00@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Wed, 16 Sep 2009 05:52:10 -0700 (PDT) Received: from sca-ea-mail-2.sun.com ([192.18.43.25]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KQ200JUDEEYRN40@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Wed, 16 Sep 2009 05:52:10 -0700 (PDT) Received: from relay11i.sun.com (ip121.net129179-4.block1.us.syntegra.com [129.179.4.121]) by sca-ea-mail-2.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n8GCmsZP027214 for ; Wed, 16 Sep 2009 12:52:10 +0000 (GMT) Received: from mmp12es.mmp.us.syntegra.com ([160.41.208.12] [160.41.208.12]) by relay11i.sun.com with ESMTP id BT-MMP-1875518 for PSARC-ext@sun.com; Wed, 16 Sep 2009 12:52:09 +0000 (Z) Received: from relay14i.sun.com (relay14i.sun.com [129.179.4.124]) by mmp12es.mmp.us.syntegra.com with ESMTP id BT-MMP-14394768 for PSARC-ext@sun.com; Wed, 16 Sep 2009 12:52:09 +0000 (Z) Received: from relay01-haj2.antispameurope.com ([83.246.65.51] [83.246.65.51]) by relay1i.sun.com with ESMTP id BT-MMP-13189277 for PSARC-ext@sun.com; Wed, 16 Sep 2009 12:52:09 +0000 (Z) Received: by relay01-haj2.antispameurope.com (ASE-Secure-MTA, from userid 1000) id BDFDF160047; Wed, 16 Sep 2009 14:52:03 +0200 (CEST) Received: from pluto.fokus.fraunhofer.de (pluto.fokus.fraunhofer.de [195.37.77.164]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by relay01-haj2.antispameurope.com (ASE-Secure-MTA) with ESMTP id 8B2F6160022; Wed, 16 Sep 2009 14:52:01 +0200 (CEST) Received: from EXCHSRV.fokus.fraunhofer.de (bohr.fokus.fraunhofer.de [10.147.9.231]) by pluto.fokus.fraunhofer.de (8.14.2/8.14.2) with SMTP id n8GCq0T6020118; Wed, 16 Sep 2009 14:52:00 +0200 (MEST) Received: from rigel ([10.147.65.195]) by EXCHSRV.fokus.fraunhofer.de with Microsoft SMTPSVC(6.0.3790.3959); Wed, 16 Sep 2009 14:52:00 +0200 Date: Wed, 16 Sep 2009 14:50:53 +0200 From: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Subject: Re: zstreamdump [PSARC/2009/491 Self Review] In-reply-to: <20090916000808.GK1033@Sun.COM> Sender: Joerg.Schilling9ab33xy531fokus.fraunhofer.de@bounce.antispameurope.com To: Tim.Haley@sun.com, Nicolas.Williams@sun.com Cc: zfs-team@sun.com, PSARC-ext@sun.com Message-id: <4ab0df2d.vE29NvKcSYF4lfST%Joerg.Schilling@fokus.fraunhofer.de> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1 Content-transfer-encoding: 8BIT X-PMX-Version: 5.4.1.325704 X-Brightmail-Tracker: AAAAAA== References: <200909160006.n8G06Ds4001856@spidey.local> <20090916000808.GK1033@Sun.COM> User-Agent: nail 11.22 3/20/05 X-OriginalArrivalTime: 16 Sep 2009 12:52:00.0599 (UTC) FILETIME=[7B753E70:01CA36CC] Status: RO Content-Length: 802 Nicolas Williams wrote: > > It'd be nice if zfs recv could do this too, no? Alternatively, it'd be > nice if there was a way to slot zstreamdump into a zfs send | ... | zfs > recv pipe. E.g., an option to zstreamdump to send its output to a file > or to stderr, passing the stream through to stdout for piping elsewhere. It looks a bit inconsistent to put a lot of functionality into programs like fpool and zfs and on the other side create new programs for minor features. Jörg -- EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin js@cs.tu-berlin.de (uni) joerg.schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/private/ ftp://ftp.berlios.de/pub/schily From Darren.Moffat@sun.com Wed Sep 16 06:20:41 2009 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n8GDKeDY012509 for ; Wed, 16 Sep 2009 06:20:40 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n8GDKafZ019938; Wed, 16 Sep 2009 14:20:39 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KQ200505FQDZR00@nwk-avmta-1.sfbay.Sun.COM>; Wed, 16 Sep 2009 06:20:37 -0700 (PDT) Received: from gmp-eb-inf-1.sun.com ([192.18.6.21]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KQ200JZ7FQCRP80@nwk-avmta-1.sfbay.Sun.COM>; Wed, 16 Sep 2009 06:20:37 -0700 (PDT) Received: from fe-emea-10.sun.com (gmp-eb-lb-1-fe1.eu.sun.com [192.18.6.7] (may be forged)) by gmp-eb-inf-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n8GDKamV010981; Wed, 16 Sep 2009 13:20:36 +0000 (GMT) Received: from conversion-daemon.fe-emea-10.sun.com by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KQ200F00F914B00@fe-emea-10.sun.com>; Wed, 16 Sep 2009 14:20:11 +0100 (BST) Received: from [192.168.1.105] (cpc2-rdng20-2-0-cust917.15-3.cable.virginmedia.com [86.28.167.150]) by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KQ2007DIFPBCID0@fe-emea-10.sun.com>; Wed, 16 Sep 2009 14:20:00 +0100 (BST) Date: Wed, 16 Sep 2009 14:19:59 +0100 From: Darren J Moffat Subject: Re: zstreamdump [PSARC/2009/491 Self Review] In-reply-to: <4ab0df2d.vE29NvKcSYF4lfST%Joerg.Schilling@fokus.fraunhofer.de> Sender: Darren.Moffat@sun.com To: Joerg Schilling Cc: Tim.Haley@sun.com, Nicolas.Williams@sun.com, zfs-team@sun.com, PSARC-ext@sun.com Message-id: <4AB0E5FF.3060400@Sun.COM> MIME-version: 1.0 Content-type: text/plain; CHARSET=US-ASCII; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200909160006.n8G06Ds4001856@spidey.local> <20090916000808.GK1033@Sun.COM> <4ab0df2d.vE29NvKcSYF4lfST%Joerg.Schilling@fokus.fraunhofer.de> User-Agent: Thunderbird 2.0.0.22 (X11/20090818) Status: RO Content-Length: 593 Joerg Schilling wrote: > Nicolas Williams wrote: > >> It'd be nice if zfs recv could do this too, no? Alternatively, it'd be >> nice if there was a way to slot zstreamdump into a zfs send | ... | zfs >> recv pipe. E.g., an option to zstreamdump to send its output to a file >> or to stderr, passing the stream through to stdout for piping elsewhere. > > It looks a bit inconsistent to put a lot of functionality into programs like > fpool and zfs and on the other side create new programs for minor features. This is a debugging tool only. -- Darren J Moffat From Darren.Moffat@Sun.COM Wed Sep 16 07:30:38 2009 Received: from sunmail2sca.sfbay.sun.com (sunmail2sca.SFBay.Sun.COM [129.145.155.234]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n8GEUcGA014269 for ; Wed, 16 Sep 2009 07:30:38 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail2sca.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.4) with ESMTP id n8GEUY7B019326; Wed, 16 Sep 2009 07:30:37 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KQ200M1FIZ0PE00@nwk-avmta-2.sfbay.sun.com>; Wed, 16 Sep 2009 07:30:36 -0700 (PDT) Received: from gmp-eb-inf-1.sun.com ([192.18.6.21]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KQ200MVHIYJET10@nwk-avmta-2.sfbay.sun.com>; Wed, 16 Sep 2009 07:30:20 -0700 (PDT) Received: from fe-emea-10.sun.com (gmp-eb-lb-1-fe1.eu.sun.com [192.18.6.7] (may be forged)) by gmp-eb-inf-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n8GEUIvF022216; Wed, 16 Sep 2009 14:30:19 +0000 (GMT) Received: from conversion-daemon.fe-emea-10.sun.com by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KQ200600H2CKI00@fe-emea-10.sun.com>; Wed, 16 Sep 2009 15:30:12 +0100 (BST) Received: from [192.168.1.105] (cpc2-rdng20-2-0-cust917.15-3.cable.virginmedia.com [86.28.167.150]) by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KQ2001K7IY3E920@fe-emea-10.sun.com>; Wed, 16 Sep 2009 15:30:03 +0100 (BST) Date: Wed, 16 Sep 2009 15:30:03 +0100 From: Darren J Moffat Subject: Re: zstreamdump [PSARC/2009/491 Self Review] In-reply-to: <4AB0E5FF.3060400@Sun.COM> Sender: Darren.Moffat@Sun.COM To: PSARC-ext@Sun.COM Cc: Tim.Haley@Sun.COM, zfs-team@Sun.COM Message-id: <4AB0F66B.20009@Sun.COM> MIME-version: 1.0 Content-type: text/plain; CHARSET=US-ASCII; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200909160006.n8G06Ds4001856@spidey.local> <20090916000808.GK1033@Sun.COM> <4ab0df2d.vE29NvKcSYF4lfST%Joerg.Schilling@fokus.fraunhofer.de> <4AB0E5FF.3060400@Sun.COM> User-Agent: Thunderbird 2.0.0.22 (X11/20090818) Status: RO Content-Length: 831 I know this case was Self Review and I agree with it being self review. It is after all a debugging tool. As a ZFS developer I've been using this tool already and it has been a huge help to me debugging problems with ZFS Crypto and send|recv. I see very little use for it by normal admins and users because unless you know how the stream is formatted and know how ZFS really works (especially how send|recv work) its output won't be that understandable. Traditionally tools like this wouldn't have been packaged at all but would have been available in bfu archives only. The plan is that bfu will go way sometime after the transition of ON building SVR4 to IPS packages so internal tools now need to be packaged up. With my ARC hat on +1 to this case - even though it doesn't strictly need it. -- Darren J Moffat From Lori.Alt@sun.com Wed Sep 16 11:37:29 2009 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n8GIbSGb011272 for ; Wed, 16 Sep 2009 11:37:28 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id n8GIbKlS018071; Thu, 17 Sep 2009 02:37:27 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KQ200E03UEEF200@nwk-avmta-2.sfbay.sun.com>; Wed, 16 Sep 2009 11:37:26 -0700 (PDT) Received: from brmea-mail-2.sun.com ([192.18.98.43]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KQ200BIIUEDPK50@nwk-avmta-2.sfbay.sun.com>; Wed, 16 Sep 2009 11:37:26 -0700 (PDT) Received: from fe-amer-09.sun.com ([192.18.109.79]) by brmea-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id n8GIbPn7000778; Wed, 16 Sep 2009 18:37:25 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KQ200F00SCV4500@mail-amer.sun.com>; Wed, 16 Sep 2009 12:37:25 -0600 (MDT) Received: from [172.20.25.227] ([unknown] [172.20.25.227]) by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KQ2004C3UE870E0@mail-amer.sun.com>; Wed, 16 Sep 2009 12:37:20 -0600 (MDT) Date: Wed, 16 Sep 2009 12:36:55 -0600 From: Lori Alt Subject: Re: zstreamdump [PSARC/2009/491 Self Review] In-reply-to: <20090916000808.GK1033@Sun.COM> Sender: Lori.Alt@sun.com To: Nicolas Williams Cc: Tim Haley , PSARC-ext@sun.com, zfs-team@sun.com Reply-to: Lori.Alt@sun.com Message-id: <4AB13047.4030501@Sun.COM> MIME-version: 1.0 Content-type: multipart/alternative; boundary="Boundary_(ID_xIKqddK47L58wsgf1lHMkA)" X-PMX-Version: 5.4.1.325704 References: <200909160006.n8G06Ds4001856@spidey.local> <20090916000808.GK1033@Sun.COM> User-Agent: Thunderbird 2.0.0.21 (X11/20090622) Status: RO Content-Length: 3469 This is a multi-part message in MIME format. --Boundary_(ID_xIKqddK47L58wsgf1lHMkA) Content-type: text/plain; CHARSET=US-ASCII; format=flowed Content-transfer-encoding: 7BIT On 09/15/09 18:08, Nicolas Williams wrote: > On Tue, Sep 15, 2009 at 06:06:13PM -0600, Tim Haley wrote: > >> NAME >> zstreamdump - dump the metadata in a ZFS send stream >> >> SYNOPSIS >> zstreamdump [-vC] >> >> DESCRIPTION >> The zstreamdump command reads a ZFS send stream from stdin and >> prints out selected fields from the metadata to stdout. By >> default, it also validates the checksums for each of the dataset >> streams embedded in the overall send stream. A summary of the >> stream contents is printed at the end. >> >> OPTIONS >> The following options are supported: >> >> -v Verbose mode. All records are dumped. Default is to >> only dump the metadata from the BEGIN and END records. >> >> -C Suppress the validation of checksums. Causes the tool to >> run faster. >> > > It'd be nice if zfs recv could do this too, no? Alternatively, it'd be > nice if there was a way to slot zstreamdump into a zfs send | ... | zfs > recv pipe. E.g., an option to zstreamdump to send its output to a file > or to stderr, passing the stream through to stdout for piping elsewhere. > > This is a good idea, but I'd rather leave it as is. This is just a rather simple and crude dumping tool. I don't want anyone assuming that this is more of a 'stream verification' tool than it really is. lori --Boundary_(ID_xIKqddK47L58wsgf1lHMkA) Content-type: text/html; CHARSET=US-ASCII Content-transfer-encoding: 7BIT On 09/15/09 18:08, Nicolas Williams wrote: 
On Tue, Sep 15, 2009 at 06:06:13PM -0600, Tim Haley wrote:
  
NAME
    zstreamdump - dump the metadata in a ZFS send stream

SYNOPSIS
    zstreamdump [-vC]

DESCRIPTION
    The zstreamdump command reads a ZFS send stream from stdin and
    prints out selected fields from the metadata to stdout.  By
    default, it also validates the checksums for each of the dataset
    streams embedded in the overall send stream.  A summary of the
    stream contents is printed at the end.

OPTIONS
    The following options are supported:

     -v       Verbose mode.  All records are dumped.  Default is to
	      only dump the metadata from the BEGIN and END records.

     -C       Suppress the validation of checksums.  Causes the tool to
	      run faster.
    

It'd be nice if zfs recv could do this too, no?  Alternatively, it'd be
nice if there was a way to slot zstreamdump into a zfs send | ... | zfs
recv pipe.  E.g., an option to zstreamdump to send its output to a file
or to stderr, passing the stream through to stdout for piping elsewhere.
This is a good idea, but I'd rather leave it as is.  This is just a rather simple and crude dumping tool.  I don't want anyone assuming that this is more of a 'stream verification' tool than it really is. 

lori

--Boundary_(ID_xIKqddK47L58wsgf1lHMkA)--