From jb25718@sac.sfbay.sun.com Wed Feb 3 15:37:27 2010 Received: from sunmail6brm.central.sun.com (sunmail6brm.Central.Sun.COM [129.147.4.169]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id o13NbR43027113 for ; Wed, 3 Feb 2010 15:37:27 -0800 (PST) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail6brm.central.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.4) with ESMTP id o13NbQK5017005; Wed, 3 Feb 2010 17:37:26 -0600 (CST) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KXA0070DHMEUF00@nwk-avmta-1.sfbay.Sun.COM>; Wed, 03 Feb 2010 15:37:26 -0800 (PST) Received: from dm-sfbay-02.sfbay.sun.com ([129.146.11.31]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KXA00F6VHME6DC0@nwk-avmta-1.sfbay.Sun.COM>; Wed, 03 Feb 2010 15:37:26 -0800 (PST) Received: from sac.sfbay.sun.com (sac.SFBay.Sun.COM [129.146.226.132]) by dm-sfbay-02.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.4) with ESMTP id o13NbQ1m002044; Wed, 03 Feb 2010 15:37:26 -0800 (PST) Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id o13NbPhj027087; Wed, 03 Feb 2010 15:37:25 -0800 (PST) Received: (from jb25718@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id o13NbPCq027083; Wed, 03 Feb 2010 15:37:25 -0800 (PST) Date: Wed, 03 Feb 2010 15:37:25 -0800 (PST) From: Jordan Brown Subject: Windows Sparse Attribute [PSARC/2010/037 FastTrack timeout 02/10/2010] To: PSARC-ext@sun.com Cc: cifs-eng@sun.com Message-id: <201002032337.o13NbPCq027083@sac.sfbay.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 5757 Template Version: @(#)sac_nextcase 1.68 02/23/09 SMI This information is Copyright 2010 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: Windows Sparse Attribute 1.2. Name of Document Author/Supplier: Author: Alan Wright 1.3 Date of This Document: 14 January, 2010 4. Technical Description 4.1. Details: This case proposes a new system attribute to support sparse files over the SMB protocol. The system attribute interface is described in: PSARC/2007/315 Extensible Attribute Interfaces Associated changes to chmod(1) and ls(1) are described in: PSARC/2007/410 Add system attribute to chmod PSARC/2007/394 ls(1) '-/' and '-%' options for system attributes The sparse attribute (XAT_SPARSE) will be added to the read-write system attributes defined in PSARC/2007/315 and will be generally available to applications to indicate sparse treatment of objects: a boolean value of true indicates that the object may be treated as sparse. Note that the sparse attribute does not indicate whether or not the file is actually sparse. Sparse-aware applications may interpret the sparse attribute as an indicator to use SEEK_DATA and SEEK_HOLE (see lseek(2)) to optimize the reading of file content. In order to set or clear the sparse attribute the consumer must have the ACE_WRITE_ATTRIBUTES permission or the PRIV_FILE_OWNER privilege. In the kernel, it will be accessible via VOP_GETATTR() and VOP_SETATTR(). In user space, it will be accessible via chmod(1), ls(1) and fgetattr(3C). No changes are required to the VOP or the function prototypes described in fgetattr(3C). From an SMB protocol perspective, there are two sparse indicators: FILE_SUPPORTS_SPARSE_FILES and FILE_ATTRIBUTE_SPARSE_FILE. FILE_SUPPORTS_SPARSE_FILES An SMB server can indicate support for sparse files by setting the FILE_SUPPORTS_SPARSE_FILES flag in the SmbTrans2QueryFsInformation response. SMB clients will then expect support for requests such as FSCTL_SET_SPARSE and FSCTL_SET_ZERO_DATA [MS-FSCC]. FILE_ATTRIBUTE_SPARSE_FILE Users and applications on an SMB client can change the sparse setting of a file by setting or clearing FILE_ATTRIBUTE_SPARSE_FILE via the FSCTL_SET_SPARSE control. When an SMB server that supports sparse files receives an FSCTL_SET_SPARSE request on a file, it should set or clear FILE_ATTRIBUTE_SPARSE_FILE on the file as appropriate. Note that there is no requirement to make the file sparse nor for the file to be sparse nor for the file system to take any action to avoid writing zeroes during file writes based on the value of the sparse attribute. If the file is truncated to zero length or superseded [MS-SMB], the sparse flag is cleared. SMB client applications can query sparse files to identify allocated ranges via FSCTL_QUERY_ALLOCATED_RANGES [MS-FSCC], which returns zero or more FILE_ALLOCATED_RANGE_BUFFER elements. Each element corresponds to an allocated range and contains a file offset and a length. Thus applications need only read non-zeroed ranges in a sparse file. When allocated ranges are copied to a sparse file, the file system will take care of the sparse regions. Note that if an application simply reads a sparse file without explicitly reading allocated ranges, the file system will fill-in the zeroed ranges and, in a copy operation, the destination will not be sparse. 4.5 Exported Interface Table |Proposed |Specified | |Stability |in what | Interface Name |Classification |Document? | Comments =============================================================================== | |This | | |Document | | | | A_SPARSE |Committed | | Added to read-write | | | view of extended | | | attribute namespace | | | | | | XAT_SPARSE |Consolidation | | Value for sparse |Private | | system attribute 4.6. Doc Impact: Modifications to the chmod(1) man page: Table 1: Attribute Names and Abbreviation Characters Attribute Name Attribute Abbreviation Character -------------- -------------------------------- + sparse s Modifications to the ls(1) man page: -/ c | v + sparse This attribute is available to users and applications to indicate that a file can be interpreted as sparse. It does not indicate whether or not the file is actually sparse and it has no special semantics on the Solaris operating system. The sparse attribute will be cleared if the file is truncated to zero length. The display characters used in compact mode (-/ c) are as follows: Attribute Name Display + sparse s The display positions are as follows: ! {|||||||||||} + |||||||||||+- s (sparse) ! ||||||||||+-- O (offline) ! |||||||||+--- u (nounlink) ! ||||||||+---- q (av_quarantined) ! |||||||+----- m (av_modified) ! ||||||+------ i (immutable) ! |||||+------- d (nodump) ! ||||+-------- a (appendonly) ! |||+--------- S (system) ! ||+---------- R (readonly) ! |+----------- H (hidden) ! +------------ A (archive) Modifications to the fgetattr(3C) man page: View Attribute Data type _______________________________________________________________ XATTR_VIEW_READWRITE ... + A_SPARSE boolean_value 5. References [MS-FSCC]: File System Control Codes http://msdn.microsoft.com/en-us/library/cc231987%28PROT.13%29.aspx [MS-SMB]: Server Message Block (SMB) Protocol Specification http://msdn.microsoft.com/en-us/library/cc246231%28PROT.10%29.aspx 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: ON 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From Darren.Moffat@sun.com Thu Feb 4 01:25:14 2010 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id o149PEes022036 for ; Thu, 4 Feb 2010 01:25:14 -0800 (PST) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.4) with ESMTP id o149PB0E057086; Thu, 4 Feb 2010 02:25:13 -0700 (MST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KXB00C058U1LN00@nwk-avmta-2.sfbay.sun.com>; Thu, 04 Feb 2010 01:25:13 -0800 (PST) Received: from gmp-eb-inf-2.sun.com ([192.18.6.24]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KXB000PZ8U06JA0@nwk-avmta-2.sfbay.sun.com>; Thu, 04 Feb 2010 01:25:12 -0800 (PST) Received: from fe-emea-10.sun.com (gmp-eb-lb-1-fe1.eu.sun.com [192.18.6.7] (may be forged)) by gmp-eb-inf-2.sun.com (8.13.7+Sun/8.12.9) with ESMTP id o149PBdW001140; Thu, 04 Feb 2010 09:25:11 +0000 (GMT) Received: from conversion-daemon.fe-emea-10.sun.com by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KXB00A0086KHU00@fe-emea-10.sun.com>; Thu, 04 Feb 2010 09:24:57 +0000 (GMT) Received: from [192.168.1.105] (cpc2-rdng20-2-0-cust917.15-3.cable.virginmedia.com [86.28.167.150]) by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KXB00DVL8T3B690@fe-emea-10.sun.com>; Thu, 04 Feb 2010 09:24:40 +0000 (GMT) Date: Thu, 04 Feb 2010 09:24:38 +0000 From: Darren J Moffat Subject: Re: Windows Sparse Attribute [PSARC/2010/037 FastTrack timeout 02/10/2010] In-reply-to: <201002032337.o13NbPCq027083@sac.sfbay.sun.com> Sender: Darren.Moffat@sun.com To: Jordan Brown Cc: PSARC-ext@sun.com, cifs-eng@sun.com Message-id: <4B6A9256.9070607@Sun.COM> MIME-version: 1.0 Content-type: text/plain; CHARSET=US-ASCII; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <201002032337.o13NbPCq027083@sac.sfbay.sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS i86pc; en-US; rv:1.9.1.5) Gecko/20100103 Lightning/1.0b1 Thunderbird/3.0 Status: RO Content-Length: 206 It is a little unfortunate that the attribute doesn't actually mean the file is sparse, but given the primary motivation for this is SMB support it seems reasonable so it gets my +1. -- Darren J Moffat From Darren.Moffat@sun.com Thu Feb 4 11:51:44 2010 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id o149PEes022036 for ; Thu, 4 Feb 2010 01:25:14 -0800 (PST) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.4) with ESMTP id o149PB0E057086; Thu, 4 Feb 2010 02:25:13 -0700 (MST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KXB00C058U1LN00@nwk-avmta-2.sfbay.sun.com>; Thu, 04 Feb 2010 01:25:13 -0800 (PST) Received: from gmp-eb-inf-2.sun.com ([192.18.6.24]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KXB000PZ8U06JA0@nwk-avmta-2.sfbay.sun.com>; Thu, 04 Feb 2010 01:25:12 -0800 (PST) Received: from fe-emea-10.sun.com (gmp-eb-lb-1-fe1.eu.sun.com [192.18.6.7] (may be forged)) by gmp-eb-inf-2.sun.com (8.13.7+Sun/8.12.9) with ESMTP id o149PBdW001140; Thu, 04 Feb 2010 09:25:11 +0000 (GMT) Received: from conversion-daemon.fe-emea-10.sun.com by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KXB00A0086KHU00@fe-emea-10.sun.com>; Thu, 04 Feb 2010 09:24:57 +0000 (GMT) Received: from [192.168.1.105] (cpc2-rdng20-2-0-cust917.15-3.cable.virginmedia.com [86.28.167.150]) by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KXB00DVL8T3B690@fe-emea-10.sun.com>; Thu, 04 Feb 2010 09:24:40 +0000 (GMT) Date: Thu, 04 Feb 2010 09:24:38 +0000 From: Darren J Moffat Subject: Re: Windows Sparse Attribute [PSARC/2010/037 FastTrack timeout 02/10/2010] In-reply-to: <201002032337.o13NbPCq027083@sac.sfbay.sun.com> Sender: Darren.Moffat@sun.com To: Jordan Brown Cc: PSARC-ext@sun.com, cifs-eng@sun.com Message-id: <4B6A9256.9070607@Sun.COM> MIME-version: 1.0 Content-type: text/plain; CHARSET=US-ASCII; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <201002032337.o13NbPCq027083@sac.sfbay.sun.com> User-Agent: Mozilla/5.0 (X11; U; SunOS i86pc; en-US; rv:1.9.1.5) Gecko/20100103 Lightning/1.0b1 Thunderbird/3.0 Status: RO Content-Length: 206 It is a little unfortunate that the attribute doesn't actually mean the file is sparse, but given the primary motivation for this is SMB support it seems reasonable so it gets my +1. -- Darren J Moffat From Jordan.Brown@sun.com Wed Feb 10 20:28:53 2010 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id o1B4Sqdx025312 for ; Wed, 10 Feb 2010 20:28:53 -0800 (PST) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.4) with ESMTP id o1B4SnFP035124 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Wed, 10 Feb 2010 21:28:52 -0700 (MST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0KXN00A0BTS1QM00@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 10 Feb 2010 20:28:49 -0800 (PST) Received: from sca-es-mail-1.sun.com ([192.18.43.132]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0KXN00FYTTS1QVC0@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 10 Feb 2010 20:28:49 -0800 (PST) Received: from fe-sfbay-09.sun.com ([192.18.43.129]) by sca-es-mail-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id o1B4Sn4q022058 for ; Wed, 10 Feb 2010 20:28:49 -0800 (PST) Received: from conversion-daemon.fe-sfbay-09.sun.com by fe-sfbay-09.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KXN00E00TPLWM00@fe-sfbay-09.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 10 Feb 2010 20:28:48 -0800 (PST) Received: from [129.145.155.152] ([unknown] [129.145.155.152]) by fe-sfbay-09.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KXN00M7ETS0NME0@fe-sfbay-09.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 10 Feb 2010 20:28:48 -0800 (PST) Date: Wed, 10 Feb 2010 20:28:48 -0800 From: Jordan Brown Subject: 2010/037 Windows Sparc Attribute Sender: Jordan.Brown@sun.com To: psarc-ext@sun.com Message-id: <4B738780.1050007@sun.com> MIME-version: 1.0 Content-type: text/plain; CHARSET=US-ASCII; format=flowed Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 User-Agent: Thunderbird 2.0.0.14 (X11/20080505) Status: RO Content-Length: 60 This case, having gotten its +1 and timed out, is approved.