From sacadmin Wed May 28 12:51:54 2008 Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m4SJpsgT017316; Wed, 28 May 2008 12:51:54 -0700 (PDT) Received: (from dr161460@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id m4SJpsfO017312; Wed, 28 May 2008 12:51:54 -0700 (PDT) Date: Wed, 28 May 2008 12:51:54 -0700 (PDT) From: Dean Roehrich Message-Id: <200805281951.m4SJpsfO017312@sac.sfbay.sun.com> To: PSARC-record@sac.sfbay.sun.com Subject: SAM-QFS Support for Solaris Zones [PSARC/2008/347 FastTrack timeout 06/04/2008] Status: RO Content-Length: 571 Template Version: @(#)sac_nextcase 1.66 04/17/08 SMI This information is Copyright 2008 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: SAM-QFS Support for Solaris Zones 1.2. Name of Document Author/Supplier: Author: Dean Roehrich 1.3 Date of This Document: 28 May, 2008 4. Technical Description See the case directory for more detail 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: unknown 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From roehrich@kickball-mn.Central.Sun.COM Wed May 28 12:54:11 2008 Received: from sunmail2sca.sfbay.sun.com (sunmail2sca.SFBay.Sun.COM [129.145.155.234]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m4SJsB1B017632 for ; Wed, 28 May 2008 12:54:11 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail2sca.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m4SJsAe7007426 for <@sunmail2sca.sfbay.sun.com:psarc-ext@sun.com>; Wed, 28 May 2008 12:54:11 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K1L00D01GMAYM00@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 28 May 2008 12:54:10 -0700 (PDT) Received: from dm-central-01.central.sun.com ([129.147.62.4]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K1L0059LGM9R1E0@nwk-avmta-2.sfbay.sun.com> for psarc-ext@sun.com (ORCPT psarc-ext@sun.com); Wed, 28 May 2008 12:54:10 -0700 (PDT) Received: from kickball-mn.Central.Sun.COM (kickball-mn.Central.Sun.COM [10.1.170.217]) by dm-central-01.central.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m4SJs9xn016866 for ; Wed, 28 May 2008 13:54:09 -0600 (MDT) Received: from kickball-mn.Central.Sun.COM (localhost [127.0.0.1]) by kickball-mn.Central.Sun.COM (8.13.6+Sun/8.13.6) with ESMTP id m4SJs91t019515 for ; Wed, 28 May 2008 14:54:09 -0500 (CDT) Received: (from roehrich@localhost) by kickball-mn.Central.Sun.COM (8.13.6+Sun/8.13.6/Submit) id m4SJs92Q019514 for psarc-ext@sun.com; Wed, 28 May 2008 14:54:09 -0500 (CDT) Date: Wed, 28 May 2008 14:54:09 -0500 From: Dean Roehrich Subject: SAM-QFS Support for Solaris Zones [PSARC/2008/347 FastTrack timeout 06/04/2008] To: PSARC-ext@sun.com Message-id: <20080528195409.GA19507@kickball-mn.Central.Sun.COM> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Content-disposition: inline X-PMX-Version: 5.4.1.325704 User-Agent: Mutt/1.5.9i Status: RO Content-Length: 4545 I am sponsoring this case for Kenichiro Kagoshima. Timeout is set for 06/04/08. The functional spec is in the case directory. Release binding is Minor. Template Version: @(#)sac_nextcase 1.66 04/17/08 SMI This information is Copyright 2008 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: SAM-QFS Support for Solaris Zones 1.2. Name of Document Author/Supplier: Author: Kenichiro Kagoshima 1.3 Date of This Document: 28 May, 2008 4. Technical Description Proposal: Modify SAM-QFS packaging to be zone-aware; provide mechanism and documentation to configure zones to use SAM-QFS filesystems and tools; and provide a mechanism to boot relevant zones after the required Shared-QFS filesystems are available for lofs mounts within those zones. Packaging: All SAM-QFS packages will be updated with the following attributes and settings, to allow installs into the global zone and to prevent the install from propagating into non-global zones and prevent the package from being visible in any non-global zones [1]: SUNW_PKG_ALLZONES=false SUNW_PKG_HOLLOW=false SUNW_PKG_THISZONE=true This does not, however, prevent the packages from being installed directly into a non-global zone. To address this the packaging will fail to install unless the zonename is 'global'. Booting zones that use Shared-QFS filesystems: When Shared-QFS filesystems are intended to be accessible from multiple non-global zones those filesystems must be mounted in the global zone and then non-global zones must use loopback mounts to access those filesystems. Problem: Any zones marked as autoboot=true can be booted before the Shared-QFS filesystems are mounted in the global zone, and loopback mounts of those filesystems executed by the zone boot process will get the covered mountpoint. Solution: To address this issue, the zones will be booted only after the Shared-QFS filesystems have been mounted in the global zone. The existing sam-fsd daemon will be modified to monitor the filesystems and will boot the zones when their required filesystems become available. Zones being booted by sam-fsd must be marked as autoboot=false, and they must be listed in /etc/opt/SUNWsamfs/samzone.conf with the names of the filesystems on which they depend. The sam-fsd daemon will start any zone as soon as the Shared-QFS filesystems requested by that zone become available. Configuring zones for Shared-QFS: The new samzone.conf file will be used to indicate which Shared-QFS filesystems are being used in zones, and will map filesystems to specific zones. The new samzoneops tool will configure zones to use SAM-QFS. This tool uses libxml2 to parse the zone config files in /etc/zones. This tool will run zonecfg(1m) to configure the zone to loopback mount the SAM-QFS /devices/pseudo/samioc@0:syscall device required by some SAM-QFS commands. It will also configure the zone to loopback mount /opt/SUNWsamfs/zone from the global zone as /opt/SUNWsamfs in the non-global zone. It will configure the zone to loopback mount any filesystems from samzone.conf that are specified for that zone. The new /opt/SUNWsamfs/zone directory hierarchy will contain all SAM-QFS commands, libraries, and manpages that are relevant in the non-global zones. Deliverables: /etc/opt/SUNWsamfs/samzone.conf /opt/SUNWsamfs/sbin/samzoneops /opt/SUNWsamfs/zone /opt/SUNWsamfs/zone/bin /opt/SUNWsamfs/zone/lib /opt/SUNWsamfs/zone/man /opt/SUNWsamfs/zone/sbin /opt/SUNWsamfs/man/man4/samzone.conf.4 /opt/SUNWsamfs/man/man1m/samzoneops.1m Exported Interfaces: samzoneops Committed Private Commandline syntax samzone.conf Committed Private Configuration syntax sam-fsd Committed Private Commandline syntax /etc/opt/SUNWsamfs/samzone.conf Committed Configuration location /opt/SUNWsamfs/sbin/samzoneops Committed Executable location /opt/SUNWsamfs/zone Committed Private Directory /opt/SUNWsamfs/zone/bin Committed Private Directory /opt/SUNWsamfs/zone/lib Committed Private Directory /opt/SUNWsamfs/zone/man Committed Private Directory /opt/SUNWsamfs/zone/sbin Committed Private Directory Imported Interfaces: SUNWlxml Library (libxml2.so.2) References: [1] http://jurassic.sfbay/shared/sac/PSARC/2004/789/attr-matrix.txt 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: N/A 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From glenn.skinner@sun.com Thu May 29 16:46:00 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m4TNjx3d028561 for ; Thu, 29 May 2008 16:45:59 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id m4TNjlHm013587; Fri, 30 May 2008 07:45:56 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K1N00H05M0G8500@nwk-avmta-2.sfbay.sun.com>; Thu, 29 May 2008 16:45:52 -0700 (PDT) Received: from ivrel.sfbay.sun.com ([129.146.74.76]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K1N00DWWM0G9S20@nwk-avmta-2.sfbay.sun.com>; Thu, 29 May 2008 16:45:52 -0700 (PDT) Received: from ivrel (ivrel [129.146.74.76]) by ivrel.sfbay.sun.com (8.13.8+Sun/8.13.8) with SMTP id m4TNjqIh022017; Thu, 29 May 2008 16:45:52 -0700 (PDT) Date: Thu, 29 May 2008 16:45:52 -0700 (PDT) From: Glenn Skinner Subject: Re: 2008/347 [SAM-QFS Support for Solaris Zones] To: PSARC-ext@sun.com, Dean.Roehrich@sun.com Reply-to: Glenn Skinner Message-id: <200805292345.m4TNjqIh022017@ivrel.sfbay.sun.com> MIME-version: 1.0 X-Mailer: dtmail 1.3.0 @(#)CDE Version 1.6_36 SunOS 5.11 sun4u sparc Content-type: TEXT/plain; charset=us-ascii Content-transfer-encoding: 7BIT Content-MD5: nmc+fHWa6D+NGz7bdL5eXQ== X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 1840 Date: Wed, 28 May 2008 14:54:09 -0500 From: Dean Roehrich Subject: SAM-QFS Support for Solaris Zones [PSARC/2008/347 FastTrack timeout 06/04/2008] ... Booting zones that use Shared-QFS filesystems: When Shared-QFS filesystems are intended to be accessible from multiple non-global zones those filesystems must be mounted in the global zone and then non-global zones must use loopback mounts to access those filesystems. Problem: Any zones marked as autoboot=true can be booted before the Shared-QFS filesystems are mounted in the global zone, and loopback mounts of those filesystems executed by the zone boot process will get the covered mountpoint. Solution: To address this issue, the zones will be booted only after the Shared-QFS filesystems have been mounted in the global zone. The existing sam-fsd daemon will be modified to monitor the filesystems and will boot the zones when their required filesystems become available. Zones being booted by sam-fsd must be marked as autoboot=false, and they must be listed in /etc/opt/SUNWsamfs/samzone.conf with the names of the filesystems on which they depend. The sam-fsd daemon will start any zone as soon as the Shared-QFS filesystems requested by that zone become available. This proposed solution strikes me as a gross hack. sam-fsd's job is to help implement file system behavior. It seems completely wrong to have to teach it about zones in the first place, much less about how to start zones. Have you looked at using SMF to manage the proper sequencing through dependencies? If something's missing that prevents that approach from working, I'd rather see the missing piece be added than to pervert sam-fsd into booting zones. -- Glenn From MAILER-DAEMON Tue Jun 3 00:15:25 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m537FObc015193 for ; Tue, 3 Jun 2008 00:15:25 -0700 (PDT) Received: from brm-avmta-1.central.sun.com (brm-avmta-1.Central.Sun.COM [129.147.4.11]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m537FMqp026171; Tue, 3 Jun 2008 08:15:22 +0100 (BST) Received: from pmxchannel-daemon.brm-avmta-1.central.sun.com by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K1V0092PLHLP100@brm-avmta-1.central.sun.com>; Tue, 03 Jun 2008 01:15:21 -0600 (MDT) Received: from jurassic-x4600.sfbay.sun.com ([129.146.17.59]) by brm-avmta-1.central.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K1V006EMLHIK3C0@brm-avmta-1.central.sun.com>; Tue, 03 Jun 2008 01:15:19 -0600 (MDT) Received: from snowdog (snowdog.SFBay.Sun.COM [129.146.228.213]) by jurassic-x4600.sfbay.sun.com (8.14.3+Sun/8.14.3) with ESMTP id m537FI3N120835; Tue, 03 Jun 2008 00:15:18 -0700 (PDT) Date: Tue, 03 Jun 2008 00:21:27 -0700 From: Dan Price Subject: Re: SAM-QFS Support for Solaris Zones [PSARC/2008/347 FastTrack timeout 06/04/2008] In-reply-to: <20080528195409.GA19507@kickball-mn.Central.Sun.COM> To: Dean Roehrich Cc: PSARC-ext@sun.com Message-id: <20080603072123.GA15662@eng.sun.com> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Content-disposition: inline X-PMX-Version: 5.4.1.325704 References: <20080528195409.GA19507@kickball-mn.Central.Sun.COM> User-Agent: Mutt/1.4.2.1i Status: RO Content-Length: 2939 On Wed 28 May 2008 at 02:54PM, Dean Roehrich wrote: > All SAM-QFS packages will be updated with the following attributes and > settings, to allow installs into the global zone and to prevent the > install from propagating into non-global zones and prevent the package > from being visible in any non-global zones [1]: > > SUNW_PKG_ALLZONES=false > SUNW_PKG_HOLLOW=false > SUNW_PKG_THISZONE=true > > This does not, however, prevent the packages from being installed > directly into a non-global zone. To address this the packaging will > fail to install unless the zonename is 'global'. Presumably there are no SAM/QFS commands provided which would be of interest to users inside of zones? I am not sufficiently familiar with the product to be sure. I would recommend you have your packaging reviewed by the Zones team if you have any further questions. > Booting zones that use Shared-QFS filesystems: > > When Shared-QFS filesystems are intended to be accessible from > multiple non-global zones those filesystems must be mounted in the > global zone and then non-global zones must use loopback mounts to > access those filesystems. Is this because there's no way to directly mount those filesystems? Why is it not acceptable to simply specify these filesystems in zonecfg (using 'add fs')? > To address this issue, the zones will be booted only after the > Shared-QFS filesystems have been mounted in the global zone. The > existing sam-fsd daemon will be modified to monitor the filesystems > and will boot the zones when their required filesystems become > available. I agree with Glenn that this is not acceptable. > Zones being booted by sam-fsd must be marked as autoboot=false, > and they must be listed in /etc/opt/SUNWsamfs/samzone.conf with the > names of the filesystems on which they depend. The sam-fsd > daemon will start any zone as soon as the Shared-QFS filesystems > requested by that zone become available. I disagree with this as well-- it fragments the zones architecture for no obvious benefit-- offloading work onto the sysadmin and making automation of zones that much more difficult. Additionally, it means that zones are not readily migrateable from host to host, since you've introduced a non-zones-managed configuration file. If you need a hook in the zones framework, then let's figure out how to provide you one, rather than hacking something onto the side. Please come talk to the zones team before proceeding with this work, via zones-core@sun.com, or we can set up a conference call. > The new samzoneops tool will configure zones to use SAM-QFS. This > tool uses libxml2 to parse the zone config files in /etc/zones. This These files are private to the zones project, are subject to change without notice, and are not an interface. You must not consume them. -dp -- Daniel Price - Solaris Kernel Engineering - dp@eng.sun.com - blogs.sun.com/dp From roehrich@kickball-mn.Central.Sun.COM Tue Jun 3 06:51:23 2008 Received: from sunmail2sca.sfbay.sun.com (sunmail2sca.SFBay.Sun.COM [129.145.155.234]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m53DpNJE022922 for ; Tue, 3 Jun 2008 06:51:23 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail2sca.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id m53DpMDn014768 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Tue, 3 Jun 2008 06:51:23 -0700 (PDT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K1W0060B3TLP400@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Tue, 03 Jun 2008 06:51:21 -0700 (PDT) Received: from dm-central-01.central.sun.com ([129.147.62.4]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K1W00BDC3TK8990@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Tue, 03 Jun 2008 06:51:21 -0700 (PDT) Received: from kickball-mn.Central.Sun.COM (kickball-mn.Central.Sun.COM [10.1.170.217]) by dm-central-01.central.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m53DpKQl059479 for ; Tue, 03 Jun 2008 07:51:20 -0600 (MDT) Received: from kickball-mn.Central.Sun.COM (localhost [127.0.0.1]) by kickball-mn.Central.Sun.COM (8.13.6+Sun/8.13.6) with ESMTP id m53DhobF027305; Tue, 03 Jun 2008 08:43:50 -0500 (CDT) Received: (from roehrich@localhost) by kickball-mn.Central.Sun.COM (8.13.6+Sun/8.13.6/Submit) id m53Dhnsw027304; Tue, 03 Jun 2008 08:43:49 -0500 (CDT) Date: Tue, 03 Jun 2008 08:43:49 -0500 From: Dean Roehrich Subject: Re: SAM-QFS Support for Solaris Zones [PSARC/2008/347 FastTrack timeout 06/04/2008] In-reply-to: <20080603072123.GA15662@eng.sun.com> To: Dan Price Cc: PSARC-ext@sun.com Message-id: <20080603134349.GA27295@kickball-mn.Central.Sun.COM> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Content-disposition: inline X-PMX-Version: 5.4.1.325704 References: <20080528195409.GA19507@kickball-mn.Central.Sun.COM> <20080603072123.GA15662@eng.sun.com> User-Agent: Mutt/1.5.9i Status: RO Content-Length: 459 On Tue, Jun 03, 2008 at 12:21:27AM -0700, Dan Price wrote: > If you need a hook in the zones framework, then let's figure out how > to provide you one, rather than hacking something onto the side. > Please come talk to the zones team before proceeding with this work, > via zones-core@sun.com, or we can set up a conference call. Dan, thanks for the pointers. I've asked Ken to do a little more prep work and then we'd like to talk to the zones team. Dean From roehrich@kickball-mn.Central.Sun.COM Tue Jun 3 09:48:48 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m53GmlTq028985 for ; Tue, 3 Jun 2008 09:48:48 -0700 (PDT) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id m53Gmi9g023301 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Wed, 4 Jun 2008 00:48:46 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K1W00G07C181G00@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Tue, 03 Jun 2008 09:48:44 -0700 (PDT) Received: from dm-central-02.central.sun.com ([129.147.62.5]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K1W00FT8C17XP00@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Tue, 03 Jun 2008 09:48:44 -0700 (PDT) Received: from kickball-mn.Central.Sun.COM (kickball-mn.Central.Sun.COM [10.1.170.217]) by dm-central-02.central.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m53Gmh0K044008 for ; Tue, 03 Jun 2008 10:48:43 -0600 (MDT) Received: from kickball-mn.Central.Sun.COM (localhost [127.0.0.1]) by kickball-mn.Central.Sun.COM (8.13.6+Sun/8.13.6) with ESMTP id m53GfDMk002046 for ; Tue, 03 Jun 2008 11:41:13 -0500 (CDT) Received: (from roehrich@localhost) by kickball-mn.Central.Sun.COM (8.13.6+Sun/8.13.6/Submit) id m53GfDul002045 for PSARC-ext@sun.com; Tue, 03 Jun 2008 11:41:13 -0500 (CDT) Date: Tue, 03 Jun 2008 11:41:13 -0500 From: Dean Roehrich Subject: Re: SAM-QFS Support for Solaris Zones [PSARC/2008/347 FastTrack timeout 06/04/2008] In-reply-to: <20080603072123.GA15662@eng.sun.com> To: PSARC-ext@sun.com Message-id: <20080603164113.GA2040@kickball-mn.Central.Sun.COM> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7BIT Content-disposition: inline X-PMX-Version: 5.4.1.325704 References: <20080528195409.GA19507@kickball-mn.Central.Sun.COM> <20080603072123.GA15662@eng.sun.com> User-Agent: Mutt/1.5.9i Status: RO Content-Length: 71 The status of this case has been changed to 'waiting need spec'. Dean