From Sebastien.Roy@Sun.COM Tue Aug 18 19:39:44 2009 Received: from dm-sfbay-01.sfbay.sun.com (dm-sfbay-01.SFBay.Sun.COM [129.145.155.118]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n7J2diek024538 for ; Tue, 18 Aug 2009 19:39:44 -0700 (PDT) Received: from brmea-mail-4.sun.com (brmea-mail-4.Sun.COM [192.18.98.36]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n7J2dhWK053710 for ; Tue, 18 Aug 2009 19:39:44 -0700 (PDT) Received: from fe-amer-10.sun.com ([192.18.109.80]) by brmea-mail-4.sun.com (8.13.6+Sun/8.12.9) with ESMTP id n7J2dh1C019364 for ; Wed, 19 Aug 2009 02:39:43 GMT MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KOL00A00R8RCP00@mail-amer.sun.com> for psarc-ext@sac.sfbay.sun.com; Tue, 18 Aug 2009 20:39:43 -0600 (MDT) Received: from [192.168.1.3] ([unknown] [173.76.19.212]) by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KOL001BVRE1OIC0@mail-amer.sun.com> for psarc-ext@sac.sfbay.sun.com; Tue, 18 Aug 2009 20:39:37 -0600 (MDT) Date: Tue, 18 Aug 2009 22:39:36 -0400 From: Sebastien Roy Subject: pool dladm link property [PSARC/2009/448 FastTrack timeout 08/25/2009] Sender: Sebastien.Roy@Sun.COM To: PSARC-ext Cc: Michael Lim Message-id: <1250649576.103950.3.camel@seb> Organization: Sun Microsystems X-Mailer: Evolution 2.26.2 Status: RO Content-Length: 4034 I'm sponsoring the following fast-track for Michael Lim. It times out on 08/25/2009. The release binding is Patch. 1. Project Summary Project Crossbow introduced the 'cpus' data link property. This property is used by the mac kernel module to bind kernel threads (poll, worker, softrings) and interrupts to the CPUs assigned to the data link. Solaris provides the concept of CPU pools which can be either manually created by administrators with poolcfg(1M) and pooladm(1M), or dynamically created when a zone is started. This project allows a data link to be assigned to a persistent pool using dladm(1M) as well as temporary pools associated with zones. -Manual pool binding A new pool property is introduced. It will allow the binding of networking threads to a pool of CPUs defined by poolcfg(1M). ex. #dladm set-linkprop -p pool=pool1 nxge0 -Default pool binding for zone links The 'pool' data link property will be temporarily set to that of the zone for links which are loaned to a non-global zone of ip-type=exclusive. 2. Technical Description: Setting of both the 'pool' and 'cpus' data link properties will not be allowed on the same data link. The cpu bindings of a data link's kernel threads will be updated if the pool is changed. If the data link's pool is deleted, the threads will be bound to CPUs in the default pool. Setting the 'pool' data link will require dladm(1M) to the existence of the named pool with libpool(3LIB). zoneadmd(1M) will use dladm_set_linkprop from libdladm(3LIB) to set the pool data link property for links which are loaned to exclusive IP non-global zones. The 'pool' data link property will be stored in the kernel much in the same way as 'maxbw', 'priority' and 'cpus' properties are stored now. Persistent link properties are stored in /etc/dladm/datalink.conf. mac kernel module will be required to resolve the pool.name to individual CPUs when the pool property is set. In order to track changes in pools, a callback mechanism will need to be added pools kernel module which will trigger an update mechanism in the mac kernel module to rebind networking threads for a network link if the associated pool has changed. The pools callback functions will be similar to cpu_setup_* functions which are used by other modules to be notified of CPU changes. 3. Interfaces: Exported Interfaces Interface Name Classification Comments --------------------------------------------------------------------------- pool Committed dladm data link property register_pool_cb Consolidation Private register callback unregister_pool_cb Consolidation Private unregister callback pool_state_change_notify Consolidation Private call registered callback functions Imported Interfaces Interface Name Classification Comments --------------------------------------------------------------------------- libpool.so Consolidation Private libpool interfaces for verifying the existence of a pool in libdladm libdladm.so Consolidation Private libdladm interfaces for setting the pool data link property from zoneadmd. 4. Reference Documents: PSARC 2006/357 Crossbow PSARC 2006/496 Improved Zones/RM Integration 6796839 Add the dladm pool link property to bind network processing to a pool of cpus. 6526471 If a datalink is bound to an zone with ip-type=exclusive, the datalink should be bound to the zone's pool. From Darren.Moffat@Sun.COM Wed Aug 19 01:59:12 2009 Received: from dm-sfbay-01.sfbay.sun.com (dm-sfbay-01.SFBay.Sun.COM [129.145.155.118]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n7J8xCsS015279 for ; Wed, 19 Aug 2009 01:59:12 -0700 (PDT) Received: from gmp-eb-inf-1.sun.com (gmp-eb-inf-1.EU.Sun.COM [192.18.6.21]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n7J8xBAj006745 for ; Wed, 19 Aug 2009 01:59:12 -0700 (PDT) Received: from fe-emea-10.sun.com (gmp-eb-lb-1-fe1.eu.sun.com [192.18.6.7] (may be forged)) by gmp-eb-inf-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n7J8x6ND002527 for ; Wed, 19 Aug 2009 08:59:06 GMT MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII; format=flowed Received: from conversion-daemon.fe-emea-10.sun.com by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KOM0030089BQR00@fe-emea-10.sun.com> for psarc-ext@sac.sfbay.sun.com; Wed, 19 Aug 2009 09:58:59 +0100 (BST) Received: from [192.168.1.105] (cpc2-rdng20-2-0-cust917.15-3.cable.virginmedia.com [86.28.167.150]) by fe-emea-10.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KOM000FA8Y9OTA0@fe-emea-10.sun.com> for psarc-ext@sac.sfbay.sun.com; Wed, 19 Aug 2009 09:58:57 +0100 (BST) Date: Wed, 19 Aug 2009 09:58:56 +0100 From: Darren J Moffat Subject: Re: pool dladm link property [PSARC/2009/448 FastTrack timeout 08/25/2009] In-reply-to: <1250649576.103950.3.camel@seb> Sender: Darren.Moffat@Sun.COM To: Sebastien Roy Cc: PSARC-ext , Michael Lim Message-id: <4A8BBED0.1040901@Sun.COM> References: <1250649576.103950.3.camel@seb> User-Agent: Thunderbird 2.0.0.21 (X11/20090623) Status: RO Content-Length: 843 Sebastien Roy wrote: > I'm sponsoring the following fast-track for Michael Lim. It times out > on 08/25/2009. The release binding is Patch. > > 1. Project Summary > > Project Crossbow introduced the 'cpus' data link property. This > property is used by the mac kernel module to bind kernel threads > (poll, worker, softrings) and interrupts to the CPUs assigned to > the data link. > > Solaris provides the concept of CPU pools which can be either > manually created by administrators with poolcfg(1M) and pooladm(1M), > or dynamically created when a zone is started. This project allows > a data link to be assigned to a persistent pool using dladm(1M) as > well as temporary pools associated with zones. Looks perfectly reasonable and has the user interface I'd expect so +1 from me. -- Darren J Moffat From Kais.Belgaied@Sun.COM Wed Aug 19 10:08:15 2009 Received: from jurassic-x4600.sfbay.sun.com (cretaceous.SFBay.Sun.COM [129.146.17.59]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n7JH8Fp9009106 for ; Wed, 19 Aug 2009 10:08:15 -0700 (PDT) Received: from [129.146.11.144] (sr1-jurassic-01.SFBay.Sun.COM [129.146.11.144]) by jurassic-x4600.sfbay.sun.com (8.14.3+Sun/8.14.3) with ESMTP id n7JH8FIK942618 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 19 Aug 2009 10:08:15 -0700 (PDT) Message-ID: <4A8C317E.4010204@Sun.COM> Date: Wed, 19 Aug 2009 10:08:14 -0700 From: Kais Belgaied User-Agent: Thunderbird 2.0.0.21 (X11/20090311) MIME-Version: 1.0 To: Darren J Moffat CC: Sebastien Roy , PSARC-ext , Michael Lim Subject: Re: pool dladm link property [PSARC/2009/448 FastTrack timeout 08/25/2009] References: <1250649576.103950.3.camel@seb> <4A8BBED0.1040901@Sun.COM> In-Reply-To: <4A8BBED0.1040901@Sun.COM> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Status: RO Content-Length: 159 On 08/19/09 01:58, Darren J Moffat wrote: > > Looks perfectly reasonable and has the user interface I'd expect so +1 > from me. > +1 from me too Kais. From Sebastien.Roy@Sun.COM Wed Aug 19 10:12:08 2009 Received: from dm-sfbay-01.sfbay.sun.com (dm-sfbay-01.SFBay.Sun.COM [129.145.155.118]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n7JHC87U009415 for ; Wed, 19 Aug 2009 10:12:08 -0700 (PDT) Received: from brmea-mail-2.sun.com (brmea-mail-2.Sun.COM [192.18.98.43]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n7JHC7lb011082 for ; Wed, 19 Aug 2009 10:12:07 -0700 (PDT) Received: from fe-amer-09.sun.com ([192.18.109.79]) by brmea-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id n7JHC7wN020549 for ; Wed, 19 Aug 2009 17:12:07 GMT MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; CHARSET=US-ASCII Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) id <0KOM00D00VD1PE00@mail-amer.sun.com> for psarc-ext@sac.sfbay.sun.com; Wed, 19 Aug 2009 11:12:07 -0600 (MDT) Received: from [129.148.174.103] ([unknown] [129.148.174.103]) by mail-amer.sun.com (Sun Java(tm) System Messaging Server 7u2-7.04 64bit (built Jul 2 2009)) with ESMTPSA id <0KOM00438VROL8F0@mail-amer.sun.com> for psarc-ext@sac.sfbay.sun.com; Wed, 19 Aug 2009 11:11:49 -0600 (MDT) Date: Wed, 19 Aug 2009 13:09:59 -0400 From: Sebastien Roy Subject: Re: pool dladm link property [PSARC/2009/448 FastTrack timeout 08/25/2009] In-reply-to: <1250649576.103950.3.camel@seb> Sender: Sebastien.Roy@Sun.COM To: PSARC-ext Cc: Michael Lim Message-id: <1250701799.13734.54.camel@strat> Organization: Sun Microsystems X-Mailer: Evolution 2.26.2 References: <1250649576.103950.3.camel@seb> Status: RO Content-Length: 60 This case was approved during today's PSARC meeting. -Seb