From jw137282@sac.sfbay.sun.com Mon Apr 27 23:29:19 2009 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n3S6TIQZ001581 for ; Mon, 27 Apr 2009 23:29:18 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id n3S6THJG004421; Mon, 27 Apr 2009 23:29:18 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KIS00L0VSOSCM00@nwk-avmta-2.sfbay.sun.com>; Mon, 27 Apr 2009 23:29:16 -0700 (PDT) Received: from dm-sfbay-01.sfbay.sun.com ([129.145.155.118]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KIS00K5VSOSD320@nwk-avmta-2.sfbay.sun.com>; Mon, 27 Apr 2009 23:29:16 -0700 (PDT) Received: from sac.sfbay.sun.com (sac.SFBay.Sun.COM [129.146.226.132]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n3S6TEOR054918; Mon, 27 Apr 2009 23:29:14 -0700 (PDT) Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n3S6TDmv001576; Mon, 27 Apr 2009 23:29:13 -0700 (PDT) Received: (from jw137282@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id n3S6TDO5001572; Mon, 27 Apr 2009 23:29:13 -0700 (PDT) Date: Mon, 27 Apr 2009 23:29:13 -0700 (PDT) From: James Walker Subject: iozone [PSARC/2009/257 FastTrack timeout 05/04/2009] To: PSARC-ext@sun.com Cc: ivan.shi@sun.com Message-id: <200904280629.n3S6TDO5001572@sac.sfbay.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 1444 I'm sponsoring this familiarity case for Ivan Shi. The requested release binding is minor. The man page has been posted in the materials directory. Template Version: @(#)sac_nextcase 1.68 02/23/09 SMI This information is Copyright 2009 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: iozone 1.2. Name of Document Author/Supplier: Author: Ivan Shi 1.3 Date of This Document: 27 April, 2009 4. Technical Description Summary ======= Iozone[1] is a filesystem benchmark tool. The benchmark generates and measures a variety of file operations. It is useful for performing a broad filesystem analysis of a computer platform. Iozone3_321 will be integrated into the SFW consolidation as part of this proposal, and will be installed as SUNWiozone. This project requests a minor release binding. Dependencies ============ None Interfaces ========== Exported Interfaces Classification Comment ------------------- -------------- ------------------ SUNWiozone Uncommitted Package /usr/benchmarks/iozone Uncommitted Command Imported Interfaces ------------------- None Reference Documents =================== [1] http://www.iozone.org/ RFE ID# 6831877 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: SFW 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From Phil.Harman@sun.com Tue Apr 28 03:34:48 2009 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n3SAYm4U002646 for ; Tue, 28 Apr 2009 03:34:48 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id n3SAYmbr044446 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Tue, 28 Apr 2009 04:34:48 -0600 (MDT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KIT00L0141X4J00@brm-avmta-1.central.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Tue, 28 Apr 2009 04:34:45 -0600 (MDT) Received: from gmp-eb-inf-2.sun.com ([192.18.6.24]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KIT00B0241WZE90@brm-avmta-1.central.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Tue, 28 Apr 2009 04:34:45 -0600 (MDT) Received: from fe-emea-10.sun.com (gmp-eb-lb-1-fe3.eu.sun.com [192.18.6.10]) by gmp-eb-inf-2.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n3SAYifN016811 for ; Tue, 28 Apr 2009 10:34:44 +0000 (GMT) Received: from conversion-daemon.fe-emea-10.sun.com by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7.0-5.01 64bit (built Feb 19 2009)) id <0KIT00G003G72800@fe-emea-10.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Tue, 28 Apr 2009 11:34:43 +0100 (BST) Received: from 218-dynamic.2014881.venues.thecloud.net ([unknown] [94.116.154.218]) by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7.0-5.01 64bit (built Feb 19 2009)) with ESMTPSA id <0KIT00CNY41S8Y80@fe-emea-10.sun.com>; Tue, 28 Apr 2009 11:34:41 +0100 (BST) Date: Tue, 28 Apr 2009 11:34:40 +0100 From: Phil Harman Subject: Re: iozone [PSARC/2009/257 FastTrack timeout 05/04/2009] In-reply-to: <200904280629.n3S6TDO5001572@sac.sfbay.sun.com> Sender: Phil.Harman@sun.com To: James Walker Cc: PSARC-ext@sun.com, Ivan.Shi@sun.com Message-id: <49F6DBC0.3000004@sun.com> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200904280629.n3S6TDO5001572@sac.sfbay.sun.com> User-Agent: Thunderbird 2.0.0.21 (Macintosh/20090302) Status: RO Content-Length: 2821 I have a number of concerns: 1) it should be called cachezone, not I/O zone Most of the examples in the short Iozone paper do not actually show I/O performance, but get side-tracked on the various caches in the system. 2) it produces hard to understand data, which leads to meaningless conclusions It does nothing useful to explore the size of the filesystem cache, and can only draw a line between cached and not-cached performance, with it being especially hard to produce data for non-cached filesystem I/O. 3) it is a support call generator I had one prestigious customer that was claiming 1GB/sec through a 4Mbps HBA. I've seen a number of other examples where I have had to make up for a poor undertanding of that the benchmark does, and why its data isn't that helpful. And what about the cases where decisions are made on unchallenged data? 3) it is not very Solaris savvy Most databases use O_DSYNC (not O_SYNC), but there is not O_DSYNC option 4) is it pro VxFS to the exclusion of UFS and others It hasVX_DIRECT support, but no notion of directio(3C) 5) the options are seemingly random, but not easily extensible 6) there is very little control over the workload mix 7) we already have filebench and so on. Phil James Walker wrote: > I'm sponsoring this familiarity case for Ivan Shi. The requested > release binding is minor. The man page has been posted in the > materials directory. > > Template Version: @(#)sac_nextcase 1.68 02/23/09 SMI > This information is Copyright 2009 Sun Microsystems > 1. Introduction > 1.1. Project/Component Working Name: > iozone > 1.2. Name of Document Author/Supplier: > Author: Ivan Shi > 1.3 Date of This Document: > 27 April, 2009 > 4. Technical Description > Summary > ======= > Iozone[1] is a filesystem benchmark tool. The benchmark generates and > measures a variety of file operations. It is useful for performing a > broad filesystem analysis of a computer platform. > > Iozone3_321 will be integrated into the SFW consolidation as part of > this proposal, and will be installed as SUNWiozone. > > This project requests a minor release binding. > > > Dependencies > ============ > > None > > > Interfaces > ========== > > Exported Interfaces Classification Comment > ------------------- -------------- ------------------ > SUNWiozone Uncommitted Package > /usr/benchmarks/iozone Uncommitted Command > > Imported Interfaces > ------------------- > None > > Reference Documents > =================== > [1] http://www.iozone.org/ > > RFE ID# 6831877 > > > 6. Resources and Schedule > 6.4. Steering Committee requested information > 6.4.1. Consolidation C-team Name: > SFW > 6.5. ARC review type: FastTrack > 6.6. ARC Exposure: open > > From James.Walker@sun.com Tue Apr 28 07:47:57 2009 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n3SEluG8005505 for ; Tue, 28 Apr 2009 07:47:56 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n3SElrEL029234 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Tue, 28 Apr 2009 15:47:55 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KIT00219FRUKA00@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.COM); Tue, 28 Apr 2009 07:47:54 -0700 (PDT) Received: from brmea-mail-2.sun.com ([192.18.98.43]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KIT00JULFRSCE90@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.COM); Tue, 28 Apr 2009 07:47:52 -0700 (PDT) Received: from fe-amer-09.sun.com ([192.18.109.79]) by brmea-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id n3SElpAg029980 for ; Tue, 28 Apr 2009 14:47:51 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7.0-5.01 64bit (built Feb 19 2009)) id <0KIT00G00FMLUM00@mail-amer.sun.com> for PSARC-ext@Sun.COM (ORCPT PSARC-ext@Sun.COM); Tue, 28 Apr 2009 08:47:51 -0600 (MDT) Received: from c-67-166-20-151.hsd1.co.comcast.net ([unknown] [129.150.35.54]) by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7.0-5.01 64bit (built Feb 19 2009)) with ESMTPSA id <0KIT00DEXFRGY0G0@mail-amer.sun.com>; Tue, 28 Apr 2009 08:47:41 -0600 (MDT) Date: Tue, 28 Apr 2009 08:47:40 -0600 From: Jim Walker Subject: Re: iozone [PSARC/2009/257 FastTrack timeout 05/04/2009] In-reply-to: <49F6DBC0.3000004@sun.com> Sender: James.Walker@sun.com To: Phil Harman Cc: PSARC-ext@sun.com, Ivan.Shi@sun.com, Brendan Gregg Reply-to: James.Walker@sun.com Message-id: <49F7170C.3020804@sun.com> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200904280629.n3S6TDO5001572@sac.sfbay.sun.com> <49F6DBC0.3000004@sun.com> User-Agent: Thunderbird 2.0.0.21 (Macintosh/20090302) Status: RO Content-Length: 3441 Phil, I understand your concerns, that's why we ran it by Brendan, who ran it by SAE. As you point out there are issues with iozone in general, and with Solaris. filebench is clearly a much better benchmarking framework. But, it is still a commonly used open source benchmark, and if we don't port it someone else will and we may be in a better position to promote some change upstream. Cheers, Jim Phil Harman wrote: > I have a number of concerns: > > 1) it should be called cachezone, not I/O zone > > Most of the examples in the short Iozone paper do not actually show I/O > performance, but get side-tracked on the various caches in the system. > > 2) it produces hard to understand data, which leads to meaningless > conclusions > > It does nothing useful to explore the size of the filesystem cache, and > can only draw a line between cached and not-cached performance, with it > being especially hard to produce data for non-cached filesystem I/O. > > 3) it is a support call generator > > I had one prestigious customer that was claiming 1GB/sec through a 4Mbps > HBA. I've seen a number of other examples where I have had to make up > for a poor undertanding of that the benchmark does, and why its data > isn't that helpful. And what about the cases where decisions are made on > unchallenged data? > > 3) it is not very Solaris savvy > > Most databases use O_DSYNC (not O_SYNC), but there is not O_DSYNC option > > 4) is it pro VxFS to the exclusion of UFS and others > > It hasVX_DIRECT support, but no notion of directio(3C) > > 5) the options are seemingly random, but not easily extensible > > 6) there is very little control over the workload mix > > 7) we already have filebench > > and so on. > > Phil > > > > James Walker wrote: >> I'm sponsoring this familiarity case for Ivan Shi. The requested >> release binding is minor. The man page has been posted in the >> materials directory. >> >> Template Version: @(#)sac_nextcase 1.68 02/23/09 SMI >> This information is Copyright 2009 Sun Microsystems >> 1. Introduction >> 1.1. Project/Component Working Name: >> iozone >> 1.2. Name of Document Author/Supplier: >> Author: Ivan Shi >> 1.3 Date of This Document: >> 27 April, 2009 >> 4. Technical Description >> Summary >> ======= >> Iozone[1] is a filesystem benchmark tool. The benchmark generates >> and measures a variety of file operations. It is useful for >> performing a >> broad filesystem analysis of a computer platform. >> >> Iozone3_321 will be integrated into the SFW consolidation as part of >> this proposal, and will be installed as SUNWiozone. >> >> This project requests a minor release binding. >> >> >> Dependencies >> ============ >> >> None >> >> >> Interfaces >> ========== >> >> Exported Interfaces Classification Comment >> ------------------- -------------- ------------------ >> SUNWiozone Uncommitted Package >> /usr/benchmarks/iozone Uncommitted Command >> >> Imported Interfaces >> ------------------- None >> Reference Documents >> =================== >> [1] http://www.iozone.org/ >> >> RFE ID# 6831877 >> >> >> 6. Resources and Schedule >> 6.4. Steering Committee requested information >> 6.4.1. Consolidation C-team Name: >> SFW >> 6.5. ARC review type: FastTrack >> 6.6. ARC Exposure: open >> >> > From James.Walker@sun.com Wed Apr 29 10:42:31 2009 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n3THgTeN029532 for ; Wed, 29 Apr 2009 10:42:30 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id n3THgHwa022653 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Thu, 30 Apr 2009 01:42:29 +0800 (SGT) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KIV0020XIIP8L00@brm-avmta-1.central.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Wed, 29 Apr 2009 11:42:26 -0600 (MDT) Received: from brmea-mail-2.sun.com ([192.18.98.43]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KIV00GFPIIP5F70@brm-avmta-1.central.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Wed, 29 Apr 2009 11:42:25 -0600 (MDT) Received: from fe-amer-09.sun.com ([192.18.109.79]) by brmea-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id n3THgPqq000131 for ; Wed, 29 Apr 2009 17:42:25 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7.0-5.01 64bit (built Feb 19 2009)) id <0KIV00000HLZA200@mail-amer.sun.com> for PSARC-ext@Sun.Com (ORCPT PSARC-ext@Sun.Com); Wed, 29 Apr 2009 11:42:25 -0600 (MDT) Received: from c-67-165-250-190.hsd1.co.comcast.net ([unknown] [129.150.36.168]) by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7.0-5.01 64bit (built Feb 19 2009)) with ESMTPSA id <0KIV00CJBIIG1600@mail-amer.sun.com> for PSARC-ext@Sun.Com (ORCPT PSARC-ext@Sun.Com); Wed, 29 Apr 2009 11:42:16 -0600 (MDT) Date: Wed, 29 Apr 2009 11:42:16 -0600 From: Jim Walker Subject: Re: iozone [PSARC/2009/257 FastTrack timeout 05/04/2009] In-reply-to: <200904280629.n3S6TDO5001572@sac.sfbay.sun.com> Sender: James.Walker@sun.com To: PSARC-ext@sun.com Cc: Ivan.Shi@sun.com Reply-to: James.Walker@sun.com Message-id: <49F89178.50509@sun.com> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200904280629.n3S6TDO5001572@sac.sfbay.sun.com> User-Agent: Thunderbird 2.0.0.21 (Macintosh/20090302) Status: RO Content-Length: 131 This case was approved at todays PSARC meeting. The project team will look at pointing to filebench in the man page. Cheers, Jim