From Tim.Haley@sun.com Fri Dec 19 15:15:33 2008 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mBJNFWui019135 for ; Fri, 19 Dec 2008 15:15:32 -0800 (PST) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id mBJNFJAw043500 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Fri, 19 Dec 2008 16:15:32 -0700 (MST) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KC500E0ZCL8BG00@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Fri, 19 Dec 2008 15:15:08 -0800 (PST) Received: from dm-central-01.central.sun.com ([129.147.62.4]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KC5004FPCL7YV60@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Fri, 19 Dec 2008 15:15:07 -0800 (PST) Received: from spidey.Central.Sun.COM (spidey.Central.Sun.COM [172.20.25.27]) by dm-central-01.central.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id mBJNF68l006779; Fri, 19 Dec 2008 16:15:06 -0700 (MST) Received: from spidey.Central.Sun.COM (localhost [127.0.0.1]) by spidey.Central.Sun.COM (8.14.3+Sun/8.14.3) with ESMTP id mBJNChvc003847; Fri, 19 Dec 2008 16:12:43 -0700 (MST) Received: (from timh@localhost) by spidey.Central.Sun.COM (8.14.3+Sun/8.14.3/Submit) id mBJNChaB003845; Fri, 19 Dec 2008 16:12:43 -0700 (MST) Date: Fri, 19 Dec 2008 16:12:43 -0700 (MST) From: Tim Haley Subject: LZMA compression for lofi [PSARC/2008/785 Self Review] To: PSARC-ext@sun.com Cc: caiman-discuss@opensolaris.org Message-id: <200812192312.mBJNChaB003845@spidey.Central.Sun.COM> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 2999 I am sponsoring the following case for Alok Aggarwal. Requested binding is minor, matching the binding for the original lofiadm compression case (PSARC/2007/569). This is a straight-forward addition allowing a new compression algorithm to be used with lofiadm. I believe this case qualifies as self-review, and have submitted it as such. If there is disagreement, please let me know and I will change it to a regular fast-track. Template Version: @(#)sac_nextcase %I% %G% SMI This information is Copyright 2008 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: LZMA compression for lofi 1.2. Name of Document Author/Supplier: Author: Alok Aggarwal 1.3 Date of This Document: 19 December, 2008 4. Technical Description This case proposes to add another compression algorithm to the list of supported algorithms for lofiadm(1M). Currently, lofiadm(1M) allows compression algorithms to be specified via the '-C' command line option. gzip-6 and gzip-9 are the two supported algorithms. This case intends to add support for LZMA (Lempel-Ziv Markov chain algorithm) as well. Rationale for adding LZMA as a supported algorithm: The LZMA algorithm offers distinct advantages in compressing binary data, it provides a much higher compression ratio than, say, gzip or bzip2. Our testing shows that it compresses between 30-40% better than gzip-9. Related CR: The work described as part of this case will be delivered with the following CR: 6785864 lzma compression support for lofi 6785871 lofiadm(1M) should mention lzma as a supported compression algorithm Command Changes The '-C' option to lofiadm(1M) will take an additional optional parameter. The changes are as follows - SYNOPSIS [...] /usr/sbin/lofiadm -C algorithm [-s segment_size] file <---- [...] OPTIONS [...] -C {gzip | gzip-N | lzma} | Compress the file with the specified compression algo- | rithm. | The gzip compression algorithm uses the same compression as the open-source gzip command. You can specify the gzip level by using the value gzip-N where N is 6 (fast) or 9 (best compression ratio). Currently, gzip, without | a number, is equivalent to gzip-6 (which is also the | default for the gzip command). lzma stands for the LZMA (Lempel-Ziv-Markov) compression | algorithm. References PSARC/2007/569 - lofi(7D) compression support http://sac.sfbay/Archives/CaseLog/arc/PSARC/2007/569 PSARC/1999/463 - lofi http://sac.sfbay/Archives/CaseLog/arc/PSARC/1999/463 LZMA numbers http://blogs.sun.com/aalok/entry/lzma_compression 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: ON 6.5. ARC review type: Automatic 6.6. ARC Exposure: open From Darren.Moffat@Sun.COM Mon Dec 22 16:36:02 2008 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mBN0a2S6013016 for ; Mon, 22 Dec 2008 16:36:02 -0800 (PST) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id mBN0Zxjt003387; Mon, 22 Dec 2008 16:36:02 -0800 (PST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KCB000030C0DS00@brm-avmta-1.central.sun.com>; Mon, 22 Dec 2008 17:36:00 -0700 (MST) Received: from gmp-eb-inf-1.sun.com ([192.18.6.21]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KCB00M1T0BZ8BD0@brm-avmta-1.central.sun.com>; Mon, 22 Dec 2008 17:36:00 -0700 (MST) Received: from fe-emea-09.sun.com (gmp-eb-lb-2-fe2.eu.sun.com [192.18.6.11]) by gmp-eb-inf-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id mBN0ZxIj026781; Tue, 23 Dec 2008 00:35:59 +0000 (GMT) Received: from conversion-daemon.fe-emea-09.sun.com by fe-emea-09.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0KCB00K0107RQH00@fe-emea-09.sun.com> (original mail from Darren.Moffat@Sun.COM); Tue, 23 Dec 2008 00:35:59 +0000 (GMT) Received: from [129.156.173.21] by fe-emea-09.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0KCB00FXM0BW8A60@fe-emea-09.sun.com>; Tue, 23 Dec 2008 00:35:59 +0000 (GMT) Date: Tue, 23 Dec 2008 00:35:56 +0000 From: Darren J Moffat Subject: Re: LZMA compression for lofi [PSARC/2008/785 Self Review] In-reply-to: <200812192312.mBJNChaB003845@spidey.Central.Sun.COM> Sender: Darren.Moffat@Sun.COM To: Tim Haley Cc: PSARC-ext@Sun.COM, caiman-discuss@opensolaris.org Message-id: <4950326C.1030004@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200812192312.mBJNChaB003845@spidey.Central.Sun.COM> User-Agent: Thunderbird 2.0.0.17 (X11/20081104) Status: RO Content-Length: 122 Does this case make LZMA available to all consumers of zmod or is the LZMA support private to lofi ? -- Darren J Moffat From Alok.Aggarwal@Sun.COM Mon Dec 22 19:33:14 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mBN3XDxX015384 for ; Mon, 22 Dec 2008 19:33:14 -0800 (PST) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id mBN3XCbp027662; Tue, 23 Dec 2008 11:33:13 +0800 (SGT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KCB00I018JBCD00@brm-avmta-1.central.sun.com>; Mon, 22 Dec 2008 20:33:11 -0700 (MST) Received: from brmea-mail-1.sun.com ([192.18.98.31]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KCB00COG8JBWB20@brm-avmta-1.central.sun.com>; Mon, 22 Dec 2008 20:33:11 -0700 (MST) Received: from fe-amer-09.sun.com ([192.18.109.79]) by brmea-mail-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id mBN3XBGr024857; Tue, 23 Dec 2008 03:33:11 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0KCB00B018HGSO00@mail-amer.sun.com> (original mail from Alok.Aggarwal@Sun.COM); Mon, 22 Dec 2008 20:33:11 -0700 (MST) Received: from sr1-ubrm-42 ([129.147.9.132]) by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0KCB005JC8JADV80@mail-amer.sun.com>; Mon, 22 Dec 2008 20:33:11 -0700 (MST) Date: Mon, 22 Dec 2008 22:33:10 -0500 (EST) From: Alok Aggarwal Subject: Re: [caiman-discuss] LZMA compression for lofi [PSARC/2008/785 Self Review] In-reply-to: <4950326C.1030004@Sun.COM> Sender: Alok.Aggarwal@Sun.COM X-X-Sender: aalok@sr1-ubrm-42 To: Darren J Moffat Cc: Tim Haley , PSARC-ext@Sun.COM, caiman-discuss@opensolaris.org Message-id: MIME-version: 1.0 Content-type: TEXT/PLAIN; format=flowed; charset=US-ASCII Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200812192312.mBJNChaB003845@spidey.Central.Sun.COM> <4950326C.1030004@Sun.COM> User-Agent: Alpine 1.00 (SOC 882 2007-12-20) Status: RO Content-Length: 260 On Tue, 23 Dec 2008, Darren J Moffat wrote: > Does this case make LZMA available to all consumers of zmod or is the > LZMA support private to lofi ? LZMA support isn't going to be private to lofi. It will be available to anyone wishing to consume it. Alok From Darren.Moffat@sun.com Mon Dec 22 19:38:36 2008 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mBN3caKv015486 for ; Mon, 22 Dec 2008 19:38:36 -0800 (PST) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id mBN3cY6i024245; Mon, 22 Dec 2008 19:38:36 -0800 (PST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KCB00I078SBVY00@brm-avmta-1.central.sun.com>; Mon, 22 Dec 2008 20:38:35 -0700 (MST) Received: from gmp-eb-inf-1.sun.com ([192.18.6.21]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KCB00CX08SAVZ20@brm-avmta-1.central.sun.com>; Mon, 22 Dec 2008 20:38:35 -0700 (MST) Received: from fe-emea-10.sun.com (gmp-eb-lb-1-fe3.eu.sun.com [192.18.6.10]) by gmp-eb-inf-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id mBN3cYRN001477; Tue, 23 Dec 2008 03:38:34 +0000 (GMT) Received: from conversion-daemon.fe-emea-10.sun.com by fe-emea-10.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0KCB00M018RAZI00@fe-emea-10.sun.com> (original mail from Darren.Moffat@Sun.COM); Tue, 23 Dec 2008 03:38:34 +0000 (GMT) Received: from [129.156.173.21] by fe-emea-10.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0KCB00EBO8S79K60@fe-emea-10.sun.com>; Tue, 23 Dec 2008 03:38:34 +0000 (GMT) Date: Tue, 23 Dec 2008 03:38:31 +0000 From: Darren J Moffat Subject: Re: [caiman-discuss] LZMA compression for lofi [PSARC/2008/785 Self Review] In-reply-to: Sender: Darren.Moffat@sun.com To: Alok Aggarwal Cc: Tim Haley , PSARC-ext@sun.com, caiman-discuss@opensolaris.org Message-id: <49505D37.6040906@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200812192312.mBJNChaB003845@spidey.Central.Sun.COM> <4950326C.1030004@Sun.COM> User-Agent: Thunderbird 2.0.0.17 (X11/20081104) Status: RO Content-Length: 407 Alok Aggarwal wrote: > > On Tue, 23 Dec 2008, Darren J Moffat wrote: > >> Does this case make LZMA available to all consumers of zmod or is the >> LZMA support private to lofi ? > > LZMA support isn't going to be private to lofi. > It will be available to anyone wishing to consume > it. Thank-you, I'm happy with this case then. I expect to see a case soon about ZFS and LZMA.... -- Darren J Moffat