From Darren.Reed@Sun.COM Mon Jun 4 17:31:48 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l550Vlh0013320 for ; Mon, 4 Jun 2007 17:31:48 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l550UKGl001366; Tue, 5 Jun 2007 01:30:22 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ500C1F02LXM00@brm-avmta-1.central.sun.com>; Mon, 04 Jun 2007 18:30:21 -0600 (MDT) Received: from sineb-mail-2.sun.com ([192.18.19.7]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ5004XN02KTVC0@brm-avmta-1.central.sun.com>; Mon, 04 Jun 2007 18:30:21 -0600 (MDT) Received: from fe-apac-03.sun.com (fe-apac-03.sun.com [192.18.19.174] (may be forged)) by sineb-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l550UJ9k002059; Tue, 05 Jun 2007 00:30:19 +0000 (GMT) Received: from conversion-daemon.mail-apac.sun.com by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0JJ400901ZXJPH00@mail-apac.sun.com> (original mail from Darren.Reed@Sun.COM); Tue, 05 Jun 2007 08:30:19 +0800 (SGT) Received: from [129.146.106.55] by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0JJ500LH102HI4F0@mail-apac.sun.com>; Tue, 05 Jun 2007 08:30:19 +0800 (SGT) Date: Mon, 04 Jun 2007 17:30:17 -0700 From: Darren.Reed@Sun.COM Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <200706042343.l54NhAac029084@zion.eng.sun.com> Sender: Darren.Reed@Sun.COM To: Matthew Ahrens Cc: PSARC-ext@Sun.COM, zfs-eng@Sun.COM Message-id: <4664AE99.8050108@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=us-ascii Content-transfer-encoding: 7BIT X-Accept-Language: en-us, en X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS i86pc; en-US; rv:1.7) Gecko/20060120 Status: RO Content-Length: 213 What is the interaction between "zfs send" and "zfs receive" with the version numbering? e.g what happens when I "zfs send" with a ZFS filesystem of version X but the remote system can only support X-1? Darren From Matthew.Ahrens@sun.com Tue Jun 5 10:00:59 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55H0ww8004996 for ; Tue, 5 Jun 2007 10:00:58 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55GxTlS013095; Tue, 5 Jun 2007 17:59:32 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600E0J9V68900@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 09:59:30 -0700 (PDT) Received: from engmail3mpk.sfbay.Sun.COM ([129.146.11.26]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ600BGY9V5OX20@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 09:59:29 -0700 (PDT) Received: from zion.eng.sun.com (zion.SFBay.Sun.COM [129.146.17.75]) by engmail3mpk.sfbay.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l55GxRui028625; Tue, 05 Jun 2007 09:59:27 -0700 (PDT) Received: from stationary.local (punchin-ahrens [10.7.251.178]) by zion.eng.sun.com (8.13.7+Sun/8.13.7) with ESMTP id l55GxQVn023986; Tue, 05 Jun 2007 09:59:26 -0700 (PDT) Date: Tue, 05 Jun 2007 09:59:23 -0700 From: Matthew Ahrens Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <4664AE99.8050108@Sun.COM> To: Darren.Reed@sun.com Cc: Matthew Ahrens , PSARC-ext@sun.com, zfs-eng@sun.com Message-id: <4665966B.5040600@sun.com> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <4664AE99.8050108@Sun.COM> User-Agent: Thunderbird 2.0.0.0 (Macintosh/20070326) Status: RO Content-Length: 463 Darren.Reed@Sun.COM wrote: > What is the interaction between "zfs send" and "zfs receive" > with the version numbering? > > e.g what happens when I "zfs send" with a ZFS filesystem > of version X but the remote system can only support X-1? The remote system will actually process the 'zfs recv' just fine, but then not be able to mount the filesystem. Unfortunately, the old code is what it is and obviously we can't change it now. See bug 6561382. --matt From sommerfeld@sun.com Tue Jun 5 11:17:47 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55IHkB0008915 for ; Tue, 5 Jun 2007 11:17:47 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55IGHHT008713; Tue, 5 Jun 2007 19:16:20 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600H03DF7L800@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 11:16:19 -0700 (PDT) Received: from eastmail2bur.East.Sun.COM ([129.148.13.40]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ600BV5DF6P480@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 11:16:18 -0700 (PDT) Received: from thunk.east.sun.com (thunk.East.Sun.COM [129.148.174.66]) by eastmail2bur.East.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l55IGHFY006619; Tue, 05 Jun 2007 14:16:17 -0400 (EDT) Received: from [IPv6:::1] (localhost [IPv6:::1]) by thunk.east.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55IGHvE020347; Tue, 05 Jun 2007 14:16:17 -0400 (EDT) Date: Tue, 05 Jun 2007 14:16:16 -0400 From: Bill Sommerfeld Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <200706042343.l54NhAac029084@zion.eng.sun.com> To: Matthew Ahrens Cc: PSARC-ext@sun.com, zfs-eng@sun.com Message-id: <1181067376.19099.17.camel@thunk> MIME-version: 1.0 X-Mailer: Evolution 2.8.1.1 Content-type: text/plain Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> Status: RO Content-Length: 771 On Mon, 2007-06-04 at 16:43 -0700, Matthew Ahrens wrote: > This case will deliver a new filesystem version, which adds support for > type information stored in directory entries. This is for compatability > with other operating systems (eg, MacOS) which return this information > in their stat structure. By any chance, is this the BSD feature which allows for faster filesystem tree-walks by optionally returning type information (directory vs non-directory vs. unsure) to directory readers in a new "d_type" field in struct dirent, allowing them to *skip* potentially expensive stat() operations on entries known to not be directories? IMHO the larger feature is worth importing if we can figure out how to make a compatible API/ABI change for it. - Bill From schilling@fokus.fraunhofer.de Tue Jun 5 12:35:30 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55JZTBH010839 for ; Tue, 5 Jun 2007 12:35:30 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55JXxEP002732; Tue, 5 Jun 2007 20:34:03 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ60040FH0RS500@brm-avmta-1.central.sun.com>; Tue, 05 Jun 2007 13:34:03 -0600 (MDT) Received: from sca-ea-mail-2.sun.com ([192.18.43.25]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ600JADH0QFJA0@brm-avmta-1.central.sun.com>; Tue, 05 Jun 2007 13:34:02 -0600 (MDT) Received: from relay24.sun.com (ip192-12-251-74.block6.us.syntegra.com [192.12.251.74]) by sca-ea-mail-2.sun.com (8.13.7+Sun/8.12.9) with ESMTP id l55JY1C1008297; Tue, 05 Jun 2007 19:34:01 +0000 (GMT) Received: from mms24es.sun.com ([150.143.232.74] [150.143.232.74]) by relay24.sun.com with ESMTP id BT-MMP-798393; Tue, 05 Jun 2007 19:34:01 +0000 (Z) Received: from mms25bas.mms.us.syntegra.com (ip192-12-251-90.block6.us.syntegra.com [192.12.251.90]) by mms24es.sun.com with ESMTP id BT-MMP-1626959; Tue, 05 Jun 2007 19:34:00 +0000 (Z) Received: from mailhub.fokus.fraunhofer.de ([193.174.154.14] [193.174.154.14]) by relay21.sun.com with ESMTP id BT-MMP-5406224; Tue, 05 Jun 2007 19:34:00 +0000 (Z) Received: from burner.fokus.fraunhofer.de (burner [10.147.65.166]) by mailhub.fokus.fraunhofer.de (8.11.6p2/8.11.6) with ESMTP id l55JXwF19693; Tue, 05 Jun 2007 21:33:59 +0200 (MEST) Received: (from jes@localhost) by burner.fokus.fraunhofer.de (8.12.9+Sun/8.12.9/Submit) id l55JWaht019370; Tue, 05 Jun 2007 21:32:36 +0200 (CEST) Date: Tue, 05 Jun 2007 21:32:36 +0200 From: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <1181067376.19099.17.camel@thunk> Sender: schilling@fokus.fraunhofer.de To: sommerfeld@sun.com, ahrens@zion.eng.sun.com Cc: zfs-eng@sun.com, PSARC-ext@sun.com Message-id: <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> MIME-version: 1.0 Content-type: text/plain; charset=ISO8859-1 Content-transfer-encoding: 8BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> User-Agent: nail 11.22 3/20/05 Status: RO Content-Length: 1400 Bill Sommerfeld wrote: > On Mon, 2007-06-04 at 16:43 -0700, Matthew Ahrens wrote: > > This case will deliver a new filesystem version, which adds support for > > type information stored in directory entries. This is for compatability > > with other operating systems (eg, MacOS) which return this information > > in their stat structure. > > By any chance, is this the BSD feature which allows for faster > filesystem tree-walks by optionally returning type information > (directory vs non-directory vs. unsure) to directory readers in a new > "d_type" field in struct dirent, allowing them to *skip* potentially > expensive stat() operations on entries known to not be directories? How could expensive in-kernel operations avoided without extending the on-disk dir format also? BSD did enhance the on-disk format. > IMHO the larger feature is worth importing if we can figure out how to > make a compatible API/ABI change for it. It would be possible to introduce a new getdents() call that produces a different format. Older applications would use the old getdents() call. Jörg -- EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin js@cs.tu-berlin.de (uni) schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/old/private/ ftp://ftp.berlios.de/pub/schily From sommerfeld@sun.com Tue Jun 5 13:05:43 2007 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55K5gA2011873 for ; Tue, 5 Jun 2007 13:05:43 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55K3tfO015218; Tue, 5 Jun 2007 14:03:57 -0600 (MDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600M0BIF4FX00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:04:16 -0700 (PDT) Received: from eastmail2bur.East.Sun.COM ([129.148.13.40]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ600BH4IF3P4E0@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:04:16 -0700 (PDT) Received: from thunk.east.sun.com (thunk.East.Sun.COM [129.148.174.66]) by eastmail2bur.East.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l55K4EnK026343; Tue, 05 Jun 2007 16:04:14 -0400 (EDT) Received: from [IPv6:::1] (localhost [IPv6:::1]) by thunk.east.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55K4Edm020715; Tue, 05 Jun 2007 16:04:14 -0400 (EDT) Date: Tue, 05 Jun 2007 16:04:13 -0400 From: Bill Sommerfeld Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> To: Joerg Schilling Cc: ahrens@zion.eng.sun.com, zfs-eng@sun.com, PSARC-ext@sun.com Message-id: <1181073853.20679.3.camel@thunk> MIME-version: 1.0 X-Mailer: Evolution 2.8.1.1 Content-type: text/plain Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> Status: RO Content-Length: 1085 On Tue, 2007-06-05 at 21:32 +0200, Joerg Schilling wrote: > Bill Sommerfeld wrote: > > > On Mon, 2007-06-04 at 16:43 -0700, Matthew Ahrens wrote: > > > This case will deliver a new filesystem version, which adds support for > > > type information stored in directory entries. This is for compatability > > > with other operating systems (eg, MacOS) which return this information > > > in their stat structure. > > > > By any chance, is this the BSD feature which allows for faster > > filesystem tree-walks by optionally returning type information > > (directory vs non-directory vs. unsure) to directory readers in a new > > "d_type" field in struct dirent, allowing them to *skip* potentially > > expensive stat() operations on entries known to not be directories? > > How could expensive in-kernel operations avoided without extending the on-disk > dir format also? The text you quoted above: "This case will deliver a new filesystem version, which adds support for type information stored in directory entries." answers your question. - Bill From casper@holland.sun.com Tue Jun 5 13:16:03 2007 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55KG3ln012270 for ; Tue, 5 Jun 2007 13:16:03 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55KEEwJ016736; Tue, 5 Jun 2007 14:14:17 -0600 (MDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600M01IWCVP00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:14:36 -0700 (PDT) Received: from sr1-eaft06-01.holland.sun.com ([129.159.237.36]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ600BSQIWAP1D0@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:14:35 -0700 (PDT) Received: from holland (room101 [129.159.130.93]) by sr1-eaft06-01.holland.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55KEWgB018700; Tue, 05 Jun 2007 22:14:33 +0200 (MEST) Date: Tue, 05 Jun 2007 22:14:32 +0200 From: Casper.Dik@sun.com Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> Sender: casper@holland.sun.com To: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Cc: sommerfeld@sun.com, ahrens@zion.eng.sun.com, zfs-eng@sun.com, PSARC-ext@sun.com Message-id: <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> Status: RO Content-Length: 819 >It would be possible to introduce a new getdents() call that produces >a different format. Older applications would use the old getdents() call. The getdents() call returns a structure which looks like: typedef struct dirent { ino_t d_ino; /* "inode number" of entry */ off_t d_off; /* offset of disk directory entry */ unsigned short d_reclen; /* length of this record */ char d_name[1]; /* name of file */ } dirent_t; It's easy to store the little bit of additional information by bumping d_reclen and adding it add the end. This would not be noticable as the name is NUL terminated and we control all the getdents return paths in the kernel. For the readdir() call it gets trickier but still not impossible. Casper From schilling@fokus.fraunhofer.de Tue Jun 5 13:40:42 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55KefxX013244 for ; Tue, 5 Jun 2007 13:40:42 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55KdAeV021767; Tue, 5 Jun 2007 21:39:15 +0100 (BST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600001K1EVT00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:39:14 -0700 (PDT) Received: from brmea-mail-1.sun.com ([192.18.98.31]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ60000QK1DVB00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:39:14 -0700 (PDT) Received: from relay2.sun.com (relay2.sun.com [150.143.103.24] (may be forged)) by brmea-mail-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l55JkCHw000354; Tue, 05 Jun 2007 20:39:13 +0000 (GMT) Received: from mms03es.sun.com ([150.143.104.54] [150.143.104.54]) by relay2.sun.com with ESMTP id BT-MMP-703467; Tue, 05 Jun 2007 20:39:08 +0000 (Z) Received: from relay01i.sun.com (ip70.net150143-60.block3.us.syntegra.com [150.143.60.70]) by mms03es.sun.com with ESMTP id BT-MMP-263341; Tue, 05 Jun 2007 20:39:08 +0000 (Z) Received: from relay43i.sun.com ([192.5.209.74] [192.5.209.74]) by relay0i.sun.com with ESMTP id BT-MMP-6853848; Tue, 05 Jun 2007 20:39:08 +0000 (Z) Received: from mailhub.fokus.fraunhofer.de ([193.174.154.14] [193.174.154.14]) by relay4i.sun.com with ESMTP id BT-MMP-6347649; Tue, 05 Jun 2007 20:39:08 +0000 (Z) Received: from burner.fokus.fraunhofer.de (burner [10.147.65.166]) by mailhub.fokus.fraunhofer.de (8.11.6p2/8.11.6) with ESMTP id l55Kd6F19994; Tue, 05 Jun 2007 22:39:06 +0200 (MEST) Received: (from jes@localhost) by burner.fokus.fraunhofer.de (8.12.9+Sun/8.12.9/Submit) id l55KbjWg019462; Tue, 05 Jun 2007 22:37:45 +0200 (CEST) Date: Tue, 05 Jun 2007 22:37:44 +0200 From: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> Sender: schilling@fokus.fraunhofer.de To: Casper.Dik@sun.com Cc: zfs-eng@sun.com, PSARC-ext@sun.com, ahrens@zion.eng.sun.com Message-id: <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> MIME-version: 1.0 Content-type: text/plain; charset=ISO8859-1 Content-transfer-encoding: 8BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> User-Agent: nail 11.22 3/20/05 Status: RO Content-Length: 2018 Casper.Dik@sun.com wrote: > > >It would be possible to introduce a new getdents() call that produces > >a different format. Older applications would use the old getdents() call. > > The getdents() call returns a structure which looks like: > > typedef struct dirent { > ino_t d_ino; /* "inode number" of entry */ > off_t d_off; /* offset of disk directory entry */ > unsigned short d_reclen; /* length of this record */ > char d_name[1]; /* name of file */ > } dirent_t; > > It's easy to store the little bit of additional information by > bumping d_reclen and adding it add the end. > > This would not be noticable as the name is NUL terminated and we > control all the getdents return paths in the kernel. > > For the readdir() call it gets trickier but still not impossible. Du you like to use strlen in the access macro? How do you like to distinguish between both formats in special if there may be padding? FreeBSD uses struct dirent { __uint32_t d_fileno; /* file number of entry */ __uint16_t d_reclen; /* length of this record */ __uint8_t d_type; /* file type, see below */ __uint8_t d_namlen; /* length of string in d_name */ #if __BSD_VISIBLE #define MAXNAMLEN 255 char d_name[MAXNAMLEN + 1]; /* name must be no longer than this */ #else char d_name[255 + 1]; /* name must be no longer than this */ #endif }; where the definition of d_name looks questionalble in special as it is desirable to increase MAXNAMELEN as I did already mention before while discussing the needs of Joliet CDs/DVDs. Jörg -- EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin js@cs.tu-berlin.de (uni) schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/old/private/ ftp://ftp.berlios.de/pub/schily From carlsonj@phorcys.east.sun.com Tue Jun 5 13:51:25 2007 Received: from sunmail4.Singapore.Sun.COM (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55KpOeH013501 for ; Tue, 5 Jun 2007 13:51:25 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.Singapore.Sun.COM (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id l55KniIP007811; Wed, 6 Jun 2007 04:49:58 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ60010HKJ8CR00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:49:56 -0700 (PDT) Received: from eastmail2bur.East.Sun.COM ([129.148.13.40]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ6000WLKJ6V900@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:49:55 -0700 (PDT) Received: from phorcys.east.sun.com (phorcys.East.Sun.COM [129.148.174.143]) by eastmail2bur.East.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l55KnrM8004614; Tue, 05 Jun 2007 16:49:53 -0400 (EDT) Received: from phorcys.east.sun.com (localhost [127.0.0.1]) by phorcys.east.sun.com (8.14.1+Sun/8.14.1) with ESMTP id l55KnqNk028473; Tue, 05 Jun 2007 16:49:52 -0400 (EDT) Received: (from carlsonj@localhost) by phorcys.east.sun.com (8.14.1+Sun/8.14.1/Submit) id l55Knhru028468; Tue, 05 Jun 2007 16:49:43 -0400 (EDT) Date: Tue, 05 Jun 2007 16:49:43 -0400 From: James Carlson Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> To: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Cc: Casper.Dik@sun.com, zfs-eng@sun.com, PSARC-ext@sun.com, ahrens@zion.eng.sun.com Message-id: <18021.52327.382492.942378@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.01 under Emacs 21.3.1 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> Status: RO Content-Length: 871 Joerg Schilling writes: > Casper.Dik@sun.com wrote: > > This would not be noticable as the name is NUL terminated and we > > control all the getdents return paths in the kernel. > > > > For the readdir() call it gets trickier but still not impossible. > > Du you like to use strlen in the access macro? I'm not sure what "like to" means here (nobody actually likes to examine bytes, do they?), but it seems to me that 'd_reclen - sizeof (uint_t)' would be a handy way to access flags hidden at the end of the record, and without doing strlen(). In any event, psarc-ext is likely not the right mailing list on which to design such an extension. -- James Carlson, Solaris Networking Sun Microsystems / 1 Network Drive 71.232W Vox +1 781 442 2084 MS UBUR02-212 / Burlington MA 01803-2757 42.496N Fax +1 781 442 1677 From casper@holland.sun.com Tue Jun 5 13:52:32 2007 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55KqWZn013610 for ; Tue, 5 Jun 2007 13:52:32 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55KohiU023416; Tue, 5 Jun 2007 14:50:46 -0600 (MDT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600K07KL6ZA00@nwk-avmta-1.sfbay.Sun.COM>; Tue, 05 Jun 2007 13:51:06 -0700 (PDT) Received: from sr1-eaft06-01.holland.sun.com ([129.159.237.36]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ600KJ2KL4VJ00@nwk-avmta-1.sfbay.Sun.COM>; Tue, 05 Jun 2007 13:51:05 -0700 (PDT) Received: from holland (room101 [129.159.130.93]) by sr1-eaft06-01.holland.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55Kp3eo034182; Tue, 05 Jun 2007 22:51:03 +0200 (MEST) Date: Tue, 05 Jun 2007 22:51:03 +0200 From: Casper.Dik@sun.com Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> Sender: casper@holland.sun.com To: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Cc: zfs-eng@sun.com, PSARC-ext@sun.com, ahrens@zion.eng.sun.com Message-id: <200706052051.l55Kp3eo034182@sr1-eaft06-01.holland.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> Status: RO Content-Length: 1053 >> The getdents() call returns a structure which looks like: >> >> typedef struct dirent { >> ino_t d_ino; /* "inode number" of entry */ >> off_t d_off; /* offset of disk directory entry */ >> unsigned short d_reclen; /* length of this record */ >> char d_name[1]; /* name of file */ >> } dirent_t; >> >> It's easy to store the little bit of additional information by >> bumping d_reclen and adding it add the end. >> >> This would not be noticable as the name is NUL terminated and we >> control all the getdents return paths in the kernel. >> >> For the readdir() call it gets trickier but still not impossible. > >Du you like to use strlen in the access macro? No, but it could easily be defined as something like: #define FTYPE(dent) (((char *)dent + dent->d_reclen - 1)[0]) (make it the last byte of the record) There's one issue, though, readdir_r does not allow this bit of trickery :-( But then, nobody in his right mind uses it anyway. Casper From Darren.Reed@sun.com Tue Jun 5 13:54:08 2007 Received: from sunmail4.Singapore.Sun.COM (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55Ks7tO013804 for ; Tue, 5 Jun 2007 13:54:08 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.Singapore.Sun.COM (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id l55KqNA1008512; Wed, 6 Jun 2007 04:52:39 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ60010NKNPGI00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:52:37 -0700 (PDT) Received: from sineb-mail-2.sun.com ([192.18.19.7]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ60006BKNNVB10@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 13:52:37 -0700 (PDT) Received: from fe-apac-04.sun.com (fe-apac-04.sun.com [192.18.19.175] (may be forged)) by sineb-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l55KqZUp025734; Tue, 05 Jun 2007 20:52:35 +0000 (GMT) Received: from conversion-daemon.mail-apac.sun.com by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) id <0JJ600H01JY09400@mail-apac.sun.com> (original mail from Darren.Reed@Sun.COM); Wed, 06 Jun 2007 04:52:35 +0800 (SGT) Received: from [129.146.106.55] by mail-apac.sun.com (Sun Java System Messaging Server 6.2-6.01 (built Apr 3 2006)) with ESMTPSA id <0JJ6009KXKNL81W2@mail-apac.sun.com>; Wed, 06 Jun 2007 04:52:35 +0800 (SGT) Date: Tue, 05 Jun 2007 13:52:32 -0700 From: Darren.Reed@sun.com Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <4665966B.5040600@sun.com> Sender: Darren.Reed@sun.com To: Matthew Ahrens Cc: Matthew Ahrens , PSARC-ext@sun.com, zfs-eng@sun.com Message-id: <4665CD10.1050001@Sun.COM> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-Accept-Language: en-us, en X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <4664AE99.8050108@Sun.COM> <4665966B.5040600@sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS i86pc; en-US; rv:1.7) Gecko/20060120 Status: RO Content-Length: 793 Matthew Ahrens wrote: > Darren.Reed@Sun.COM wrote: > >> What is the interaction between "zfs send" and "zfs receive" >> with the version numbering? >> >> e.g what happens when I "zfs send" with a ZFS filesystem >> of version X but the remote system can only support X-1? > > > The remote system will actually process the 'zfs recv' just fine, but > then not be able to mount the filesystem. Unfortunately, the old code > is what it is and obviously we can't change it now. See bug 6561382. Is this worth a change to the man page for either of 'zfs send' or 'zfs recv' so that users have something to read before they scratch their heads or pickup the phone? I suppose if this were a full case, that bug would be a TCR for the case...do we have the equivalent for fast-tracks? Darren From Nicolas.Williams@sun.com Tue Jun 5 14:02:23 2007 Received: from sunmail3mpk.sfbay.sun.com (sunmail3mpk.SFBay.Sun.COM [129.146.11.52]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55L2NWR014130 for ; Tue, 5 Jun 2007 14:02:23 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail3mpk.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55L0tp9002714; Tue, 5 Jun 2007 14:00:56 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600103L1JUG00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 14:00:55 -0700 (PDT) Received: from localhost.Central.Sun.COM ([129.153.128.213]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ6000IFL1IV710@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 14:00:54 -0700 (PDT) Received: from localhost.Central.Sun.COM (localhost [127.0.0.1]) by localhost.Central.Sun.COM (8.14.1+Sun/8.14.1) with ESMTP id l55L05SL005989; Tue, 05 Jun 2007 16:00:05 -0500 (CDT) Received: (from nw141292@localhost) by localhost.Central.Sun.COM (8.14.1+Sun/8.14.1/Submit) id l55L05pC005988; Tue, 05 Jun 2007 16:00:05 -0500 (CDT) Date: Tue, 05 Jun 2007 16:00:05 -0500 From: Nicolas Williams Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <200706052051.l55Kp3eo034182@sr1-eaft06-01.holland.sun.com> To: Casper.Dik@sun.com Cc: Joerg Schilling , zfs-eng@sun.com, PSARC-ext@sun.com, ahrens@zion.eng.sun.com Message-id: <20070605210005.GT2999@Sun.COM> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Content-disposition: inline X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> <200706052051.l55Kp3eo034182@sr1-eaft06-01.holland.sun.com> X-Authentication-warning: localhost.Central.Sun.COM: nw141292 set sender to Nicolas.Williams@sun.com using -f User-Agent: Mutt/1.5.7i Status: RO Content-Length: 493 On Tue, Jun 05, 2007 at 10:51:03PM +0200, Casper.Dik@Sun.COM wrote: > >Du you like to use strlen in the access macro? > > No, but it could easily be defined as something like: > > #define FTYPE(dent) (((char *)dent + dent->d_reclen - 1)[0]) > > (make it the last byte of the record) The next extension of this sort would then have to resort to strlen(), so maybe the last byte or more bytes should be a length or flag so that we can add d_type now and other stuff later in this same way. From schilling@fokus.fraunhofer.de Tue Jun 5 14:53:36 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55Lra0Z015137 for ; Tue, 5 Jun 2007 14:53:36 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l55Lpqn7011571; Tue, 5 Jun 2007 22:52:08 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ600E0FNETBZ00@brm-avmta-1.central.sun.com>; Tue, 05 Jun 2007 15:52:05 -0600 (MDT) Received: from brmea-mail-4.sun.com ([192.18.98.36]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ600BISNETA020@brm-avmta-1.central.sun.com>; Tue, 05 Jun 2007 15:52:05 -0600 (MDT) Received: from relay2.sun.com (relay2.sun.com [150.143.103.24] (may be forged)) by brmea-mail-4.sun.com (8.13.6+Sun/8.12.9) with ESMTP id l55LXpam026870; Tue, 05 Jun 2007 21:52:05 +0000 (GMT) Received: from mms03es.sun.com ([150.143.104.54] [150.143.104.54]) by relay2.sun.com with ESMTP id BT-MMP-713628; Tue, 05 Jun 2007 21:52:04 +0000 (Z) Received: from relay02i.sun.com (ip72.net150143-60.block3.us.syntegra.com [150.143.60.72]) by mms03es.sun.com with ESMTP id BT-MMP-297751; Tue, 05 Jun 2007 21:52:03 +0000 (Z) Received: from relay44i.sun.com ([192.5.209.118] [192.5.209.118]) by relay0i.sun.com with ESMTP id BT-MMP-750220; Tue, 05 Jun 2007 21:52:03 +0000 (Z) Received: from mailhub.fokus.fraunhofer.de ([193.174.154.14] [193.174.154.14]) by relay4i.sun.com with ESMTP id BT-MMP-3400949; Tue, 05 Jun 2007 21:52:03 +0000 (Z) Received: from burner.fokus.fraunhofer.de (burner [10.147.65.166]) by mailhub.fokus.fraunhofer.de (8.11.6p2/8.11.6) with ESMTP id l55Lq2F20282; Tue, 05 Jun 2007 23:52:02 +0200 (MEST) Received: (from jes@localhost) by burner.fokus.fraunhofer.de (8.12.9+Sun/8.12.9/Submit) id l55LodHd019494; Tue, 05 Jun 2007 23:50:39 +0200 (CEST) Date: Tue, 05 Jun 2007 23:50:39 +0200 From: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <18021.52327.382492.942378@gargle.gargle.HOWL> Sender: schilling@fokus.fraunhofer.de To: james.d.carlson@Sun.COM Cc: zfs-eng@Sun.COM, PSARC-ext@Sun.COM, Casper.Dik@Sun.COM, ahrens@zion.eng.sun.com Message-id: <4665daaf.syqQx8N5giNTbilF%Joerg.Schilling@fokus.fraunhofer.de> MIME-version: 1.0 Content-type: text/plain; charset=ISO8859-1 Content-transfer-encoding: 8BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> <18021.52327.382492.942378@gargle.gargle.HOWL> User-Agent: nail 11.22 3/20/05 Status: RO Content-Length: 624 James Carlson wrote: > In any event, psarc-ext is likely not the right mailing list on which > to design such an extension. This sounds strange! Someone brought up this idea in this list. If you believe that this is a deviation from the topic, then you should include the topic in the sunbect. Jörg -- EMail:joerg@schily.isdn.cs.tu-berlin.de (home) Jörg Schilling D-13353 Berlin js@cs.tu-berlin.de (uni) schilling@fokus.fraunhofer.de (work) Blog: http://schily.blogspot.com/ URL: http://cdrecord.berlios.de/old/private/ ftp://ftp.berlios.de/pub/schily From Matthew.Ahrens@sun.com Tue Jun 5 15:22:46 2007 Received: from sunmail4.Singapore.Sun.COM (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l55MMjYA016072 for ; Tue, 5 Jun 2007 15:22:45 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.Singapore.Sun.COM (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id l55MLHRE002907; Wed, 6 Jun 2007 06:21:18 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ60050VORF5H00@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 15:21:15 -0700 (PDT) Received: from engmail3mpk.sfbay.Sun.COM ([129.146.11.26]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ6000O8ORCV780@nwk-avmta-2.sfbay.sun.com>; Tue, 05 Jun 2007 15:21:12 -0700 (PDT) Received: from zion.eng.sun.com (zion.SFBay.Sun.COM [129.146.17.75]) by engmail3mpk.sfbay.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l55MLCC9004600; Tue, 05 Jun 2007 15:21:12 -0700 (PDT) Received: from stationary.local (punchin-ahrens [10.7.251.178]) by zion.eng.sun.com (8.13.7+Sun/8.13.7) with ESMTP id l55MLAUD003319; Tue, 05 Jun 2007 15:21:10 -0700 (PDT) Date: Tue, 05 Jun 2007 15:21:06 -0700 From: Matthew Ahrens Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <1181067376.19099.17.camel@thunk> To: Bill Sommerfeld Cc: Matthew Ahrens , PSARC-ext@sun.com, zfs-eng@sun.com Message-id: <4665E1D2.40503@sun.com> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> User-Agent: Thunderbird 2.0.0.0 (Macintosh/20070326) Status: RO Content-Length: 976 Bill Sommerfeld wrote: > On Mon, 2007-06-04 at 16:43 -0700, Matthew Ahrens wrote: >> This case will deliver a new filesystem version, which adds support for >> type information stored in directory entries. This is for compatability >> with other operating systems (eg, MacOS) which return this information >> in their stat structure. > > By any chance, is this the BSD feature which allows for faster > filesystem tree-walks by optionally returning type information > (directory vs non-directory vs. unsure) to directory readers in a new > "d_type" field in struct dirent, allowing them to *skip* potentially > expensive stat() operations on entries known to not be directories? Yes. > IMHO the larger feature is worth importing if we can figure out how to > make a compatible API/ABI change for it. Agreed, but that is outside the scope of this case. Once this case is integrated, exporting such an API would require no further on-disk format changes to ZFS. --matt From carlsonj@phorcys.east.sun.com Wed Jun 6 04:16:55 2007 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l56BGtk7000165 for ; Wed, 6 Jun 2007 04:16:55 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l56BF7Bj018799; Wed, 6 Jun 2007 05:15:08 -0600 (MDT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ700I07OLSQX00@nwk-avmta-1.sfbay.Sun.COM>; Wed, 06 Jun 2007 04:15:28 -0700 (PDT) Received: from eastmail2bur.East.Sun.COM ([129.148.13.40]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ70045IOLRKW90@nwk-avmta-1.sfbay.Sun.COM>; Wed, 06 Jun 2007 04:15:28 -0700 (PDT) Received: from phorcys.east.sun.com (phorcys.East.Sun.COM [129.148.174.143]) by eastmail2bur.East.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l56BFPXn005996; Wed, 06 Jun 2007 07:15:25 -0400 (EDT) Received: from phorcys.east.sun.com (localhost [127.0.0.1]) by phorcys.east.sun.com (8.14.1+Sun/8.14.1) with ESMTP id l56BFPih000254; Wed, 06 Jun 2007 07:15:25 -0400 (EDT) Received: (from carlsonj@localhost) by phorcys.east.sun.com (8.14.1+Sun/8.14.1/Submit) id l56BFP6r000251; Wed, 06 Jun 2007 07:15:25 -0400 (EDT) Date: Wed, 06 Jun 2007 07:15:25 -0400 From: James Carlson Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <4665daaf.syqQx8N5giNTbilF%Joerg.Schilling@fokus.fraunhofer.de> To: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling) Cc: zfs-eng@sun.com, PSARC-ext@sun.com, ahrens@zion.eng.sun.com, Casper.Dik@sun.com Message-id: <18022.38733.390342.175619@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.01 under Emacs 21.3.1 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> <18021.52327.382492.942378@gargle.gargle.HOWL> <4665daaf.syqQx8N5giNTbilF%Joerg.Schilling@fokus.fraunhofer.de> Status: RO Content-Length: 999 Joerg Schilling writes: > James Carlson wrote: > > > In any event, psarc-ext is likely not the right mailing list on which > > to design such an extension. > > This sounds strange! > > Someone brought up this idea in this list. > > If you believe that this is a deviation from the topic, then you should > include the topic in the sunbect. Conjecture about what could be done at some point in the future with dirent isn't currently part of the case under review. The one on-topic issue I see here is whether the original case as presented was complete without a consumer for this new directory type information. I didn't see a consumer, so should that part be deferred until there's something that can actually make use of this information? -- James Carlson, Solaris Networking Sun Microsystems / 1 Network Drive 71.232W Vox +1 781 442 2084 MS UBUR02-212 / Burlington MA 01803-2757 42.496N Fax +1 781 442 1677 From casper@holland.sun.com Wed Jun 6 04:21:45 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l56BLgKR000290 for ; Wed, 6 Jun 2007 04:21:44 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l56BKCoF014875; Wed, 6 Jun 2007 12:20:14 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ70050DOTN7100@brm-avmta-1.central.sun.com>; Wed, 06 Jun 2007 05:20:11 -0600 (MDT) Received: from sr1-eaft06-01.holland.sun.com ([129.159.237.36]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ700J1SOTMKR60@brm-avmta-1.central.sun.com>; Wed, 06 Jun 2007 05:20:11 -0600 (MDT) Received: from holland (room101 [129.159.130.93]) by sr1-eaft06-01.holland.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l56BK9Ns008611; Wed, 06 Jun 2007 13:20:09 +0200 (MEST) Date: Wed, 06 Jun 2007 13:20:09 +0200 From: Casper.Dik@sun.com Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <18022.38733.390342.175619@gargle.gargle.HOWL> Sender: casper@holland.sun.com To: James Carlson Cc: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling), zfs-eng@sun.com, PSARC-ext@sun.com, ahrens@zion.eng.sun.com Message-id: <200706061120.l56BK9Ns008611@sr1-eaft06-01.holland.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> <18021.52327.382492.942378@gargle.gargle.HOWL> <4665daaf.syqQx8N5giNTbilF%Joerg.Schilling@fokus.fraunhofer.de> <18022.38733.390342.175619@gargle.gargle.HOWL> Status: RO Content-Length: 411 >The one on-topic issue I see here is whether the original case as >presented was complete without a consumer for this new directory type >information. I didn't see a consumer, so should that part be deferred >until there's something that can actually make use of this >information? The consumer was mentioned I believe; it's "MacOS X". The initial consumer, then, would be the MacOS X kernel code. Casper From carlsonj@phorcys.east.sun.com Wed Jun 6 04:48:09 2007 Received: from sunmail4.Singapore.Sun.COM (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l56Bm896000490 for ; Wed, 6 Jun 2007 04:48:09 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.Singapore.Sun.COM (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id l56Bkdd6029616; Wed, 6 Jun 2007 19:46:41 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ700J07Q1RC500@nwk-avmta-2.sfbay.sun.com>; Wed, 06 Jun 2007 04:46:39 -0700 (PDT) Received: from eastmail4bur.east.Sun.COM ([129.148.13.1]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ7002CPQ1R20E0@nwk-avmta-2.sfbay.sun.com>; Wed, 06 Jun 2007 04:46:39 -0700 (PDT) Received: from phorcys.east.sun.com (phorcys.East.Sun.COM [129.148.174.143]) by eastmail4bur.east.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l56BkaOD028206; Wed, 06 Jun 2007 07:46:36 -0400 (EDT) Received: from phorcys.east.sun.com (localhost [127.0.0.1]) by phorcys.east.sun.com (8.14.1+Sun/8.14.1) with ESMTP id l56BkaIf000329; Wed, 06 Jun 2007 07:46:36 -0400 (EDT) Received: (from carlsonj@localhost) by phorcys.east.sun.com (8.14.1+Sun/8.14.1/Submit) id l56BkagF000326; Wed, 06 Jun 2007 07:46:36 -0400 (EDT) Date: Wed, 06 Jun 2007 07:46:36 -0400 From: James Carlson Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <200706061120.l56BK9Ns008611@sr1-eaft06-01.holland.sun.com> To: Casper.Dik@Sun.COM Cc: Joerg.Schilling@fokus.fraunhofer.de (Joerg Schilling), zfs-eng@Sun.COM, PSARC-ext@Sun.COM, ahrens@zion.eng.sun.com Message-id: <18022.40604.433925.635528@gargle.gargle.HOWL> MIME-version: 1.0 X-Mailer: VM 7.01 under Emacs 21.3.1 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> <18021.52327.382492.942378@gargle.gargle.HOWL> <4665daaf.syqQx8N5giNTbilF%Joerg.Schilling@fokus.fraunhofer.de> <18022.38733.390342.175619@gargle.gargle.HOWL> <200706061120.l56BK9Ns008611@sr1-eaft06-01.holland.sun.com> Status: RO Content-Length: 777 Casper.Dik@Sun.COM writes: > > >The one on-topic issue I see here is whether the original case as > >presented was complete without a consumer for this new directory type > >information. I didn't see a consumer, so should that part be deferred > >until there's something that can actually make use of this > >information? > > The consumer was mentioned I believe; it's "MacOS X". > > The initial consumer, then, would be the MacOS X kernel code. The relationship is a little unclear to me (what part do we look at and what part don't we?), but ok. -- James Carlson, Solaris Networking Sun Microsystems / 1 Network Drive 71.232W Vox +1 781 442 2084 MS UBUR02-212 / Burlington MA 01803-2757 42.496N Fax +1 781 442 1677 From Matthew.Ahrens@Sun.COM Wed Jun 6 08:56:24 2007 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id l56FuNc3007603 for ; Wed, 6 Jun 2007 08:56:24 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id l56Fso2B013345; Wed, 6 Jun 2007 16:54:56 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0JJ8001051JICR00@brm-avmta-1.central.sun.com>; Wed, 06 Jun 2007 09:54:54 -0600 (MDT) Received: from engmail3mpk.sfbay.Sun.COM ([129.146.11.26]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0JJ800IBU1JHG770@brm-avmta-1.central.sun.com>; Wed, 06 Jun 2007 09:54:53 -0600 (MDT) Received: from zion.eng.sun.com (zion.SFBay.Sun.COM [129.146.17.75]) by engmail3mpk.sfbay.Sun.COM (8.13.6+Sun/8.13.6/ENSMAIL,v2.2) with ESMTP id l56Fspan001748; Wed, 06 Jun 2007 08:54:51 -0700 (PDT) Received: from stationary.local (punchin-ahrens [10.7.251.178]) by zion.eng.sun.com (8.13.7+Sun/8.13.7) with ESMTP id l56FsonV025235; Wed, 06 Jun 2007 08:54:50 -0700 (PDT) Date: Wed, 06 Jun 2007 08:54:42 -0700 From: Matthew Ahrens Subject: Re: zfs upgrade [PSARC/2007/328 FastTrack timeout 06/13/2007] In-reply-to: <200706061120.l56BK9Ns008611@sr1-eaft06-01.holland.sun.com> To: Casper.Dik@Sun.COM Cc: James Carlson , Joerg Schilling , zfs-eng@Sun.COM, PSARC-ext@Sun.COM, ahrens@zion.eng.sun.com Message-id: <4666D8C2.2010807@sun.com> MIME-version: 1.0 Content-type: text/plain; charset=ISO-8859-1; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.2.0.264296 References: <200706042343.l54NhAac029084@zion.eng.sun.com> <1181067376.19099.17.camel@thunk> <4665ba54.aR49BTz8WNokaVKa%Joerg.Schilling@fokus.fraunhofer.de> <200706052014.l55KEWgB018700@sr1-eaft06-01.holland.sun.com> <4665c998.aRR6sSJiUgYk67zG%Joerg.Schilling@fokus.fraunhofer.de> <18021.52327.382492.942378@gargle.gargle.HOWL> <4665daaf.syqQx8N5giNTbilF%Joerg.Schilling@fokus.fraunhofer.de> <18022.38733.390342.175619@gargle.gargle.HOWL> <200706061120.l56BK9Ns008611@sr1-eaft06-01.holland.sun.com> User-Agent: Thunderbird 2.0.0.0 (Macintosh/20070326) Status: RO Content-Length: 741 Casper.Dik@Sun.COM wrote: >> The one on-topic issue I see here is whether the original case as >> presented was complete without a consumer for this new directory type >> information. I didn't see a consumer, so should that part be deferred >> until there's something that can actually make use of this >> information? > > The consumer was mentioned I believe; it's "MacOS X". > > The initial consumer, then, would be the MacOS X kernel code. That's correct. It's in Sun's and the OpenSolaris community's interest to keep the ZFS on-disk format the same between all implementations. Due to various logistical issues, it's easiest for us (Sun) to make this change for OSX, to ensure that the on-disk format does not deviate. --matt