From sacadmin Wed Mar 4 21:44:22 2009 Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n255iMUt005928; Wed, 4 Mar 2009 21:44:22 -0800 (PST) Received: (from xc149992@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id n255iMvQ005924; Wed, 4 Mar 2009 21:44:22 -0800 (PST) Date: Wed, 4 Mar 2009 21:44:22 -0800 (PST) From: Xiang-Dong Frank Che Message-Id: <200903050544.n255iMvQ005924@sac.sfbay.sun.com> To: PSARC-record@sac.sfbay.sun.com Subject: Integrate LSI MegaRAID SAS2.0 Controller HBA Driver (mr_sas) into Solaris [PSARC/2009/154 FastTrack timeout 03/12/2009] Status: RO Content-Length: 610 Template Version: @(#)sac_nextcase 1.68 02/23/09 SMI This information is Copyright 2009 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: Integrate LSI MegaRAID SAS2.0 Controller HBA Driver (mr_sas) into Solaris 1.2. Name of Document Author/Supplier: Author: Susan Scheufele 1.3 Date of This Document: 04 March, 2009 4. Technical Description See the case directory for more detail 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: ON 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From Frank.Che@Sun.COM Wed Mar 4 22:57:37 2009 Received: from dm-sfbay-01.sfbay.sun.com (dm-sfbay-01.SFBay.Sun.COM [129.145.155.118]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n256vb5f010146 for ; Wed, 4 Mar 2009 22:57:37 -0800 (PST) Received: from sineb-mail-1.sun.com ([192.18.19.6]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n256vaSc041363 for ; Wed, 4 Mar 2009 22:57:37 -0800 (PST) Received: from fe-apac-06.sun.com (fe-apac-06.sun.com [192.18.19.177] (may be forged)) by sineb-mail-1.sun.com (8.13.6+Sun/8.12.9) with ESMTP id n256vVaP026623 for ; Thu, 5 Mar 2009 06:57:31 GMT MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; format=flowed; charset=ISO-8859-1 Received: from conversion-daemon.mail-apac.sun.com by mail-apac.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) id <0KG000100TSX6G00@mail-apac.sun.com> for psarc-ext@sac.sfbay.sun.com; Thu, 05 Mar 2009 14:57:31 +0800 (SGT) Received: from [129.158.218.60] ([unknown] [129.158.218.60]) by mail-apac.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) with ESMTPSA id <0KG000M5KTZCXB90@mail-apac.sun.com>; Thu, 05 Mar 2009 14:57:12 +0800 (SGT) Date: Thu, 05 Mar 2009 14:55:12 +0800 From: Frank Che Subject: Integrate LSI MegaRAID SAS2.0 Controller HBA Driver (mr_sas) into Solaris [PSARC 2009/154] Sender: Frank.Che@Sun.COM To: psarc-ext@sac.sfbay.sun.com Cc: Susan Scheufele , Yu Wu , lsi-megasas-core@Sun.COM Message-id: <49AF7750.5000707@sun.com> User-Agent: Thunderbird 2.0.0.4 (X11/20070622) Status: RO Content-Length: 5333 I'm sponsoring this fast track for Susan Scheufele and Yu Wu. Requested release binding is Patch. Timer is set to Mar 12, 2009. -Frank 2. Project Summary This project integrates LSI MegaRAID SAS2.0 Controller HBA driver, mr_sas, into Solaris. Requested Release binding is Patch. LSI's next generation of SAS2.0 HBA controllers will support a new driver based on the LSI's MegaRAID Firmware Interface (MFI). The driver was developed by LSI, and the driver capabilities are significantly upgraded from the previous generation driver, including dynamic enumeration, SMP support, Hot Plug for Disk and HBA, tape pass through, and a related kmdb module. The new driver supports the LSI SAS2108(Liberator) controller. 4. Technical Description: 4.1. Details: The mr_sas(7d) driver will support LSI's MegaRAID SAS2.0 controllers, and will not support LSI's SAS1.0 controllers. The on-disk metadata format is compatible, so that MegaRAID drives can be moved from SAS1.0 to SAS2.0 controllers without fear of data loss, and vice versa. The mr_sas(7d) driver will be DDI and SCSAv2-complaint, as much as possible. The driver will provide new functionality compared to the existing megasas(7d) driver: dynamic enumeration, SMP, drive hot plug, and a related kmdb module. Additional software features are planned to be implemented by LSI and Sun in separate phases over the next year. 4.3. In Scope: The following features are supported in the initial version of the driver. X86 Support - starting with X86 due to limited hardware availability Sparc Support - available within 2 builds of the X86 support 64 bit DMA - normal HBA feature, was missing from gen1 driver initially Dynamic Enumeration - .conf file not required to attach logical drives SMP Enumeration - logical drives may be accessed via a SAS expander FMA level 2 support - checks for errors on DMA and PIO accesses Hot Plug of Drives - handled via the LSI management utilities MSI-X support - for MSI and MSI-X interrupts. Solaris quiesce - for fastboot support mdb walker - provides driver-related kmdb info Expander pass through - for specified SAS expanders 4.4. Out of Scope: The following features are planned as follow-on enhancements for the driver. They are not supported in the initial release of the driver due to time-to-market considerations. Tape pass through - for specified SAS tape drives Hot Plug of HBA - first RFE following Sparc, required for blades SMP Multipathing - requirements need further clarification, for load balancing and failover Power Management - LSI is investigating the fw support required Timeout support - LSI is investigating the fw support required PCI-E relaxed ordering - verified that the device supports it kstats - part of follow-on performance work kmem_cache_alloc - if performance testing warrants its usage fwflash plugin - firmware upgrade for the card and drives is already handled via the LSI management utilities FMA 2.5 support - support for LSI MegaRAID-specific error conditions, is already handled via the LSI management utilities The following features are not supported with mr_sas(7D): raidctl plugin - Sun has made a business choice to pass through the responsibility for the device configuration tools to the vendor (eg, LSI). There is no "value add" in adding the same capabilities that LSI provides today. MPXIO - generically does not work with RAID drivers JBOD passthrough - no near-term support for this feature is planned iPort code - only applies if there is JBOD passthrough support WWN registration of devices - no support for this feature is planned by LSI for this driver 4.5. Interfaces: The project exports the following interfaces: Interface Name Stability Comments --------------- --------------- ------------- mr_sas(7D) Committed Driver name SUNWmrsas Committed Package name 4.6. Doc Impact: A man page will be created for the mr_sas(7d) driver. 4.7. Admin/Config Impact: The BIOS will be used to create RAID volumes for X86 platforms. There is a minimal Fcode interface that may be used to create RAID volumes for Sparc platforms. In addition, LSI's RAID configuration and management utilities are supported with this driver, and are available for download from LSI's website. 4.8. HA Impact: Not supported due to lack of MPXIO, which generically does not work with hardware RAID drivers. 4.10. Packaging & Delivery: The mr_sas(7d) driver will be delivered initially on the x86 architectures, and shortly thereafter on Sparc. The mr_sas(7d) driver will be included as: /kernel/drv/mr_sas /kernel/drv/mr_sas.conf /kernel/drv/amd64/mr_sas /kernel/drv/sparcv9/mr_sas The mr_sas(7d) manpage will be included in SUNWman. 6. Resources and Schedule: 6.4. Product Approval Committee requested information: 6.4.1. Consolidation or Component Name: ON 6.5. ARC review type: Fast Track 6.6. ARC Exposure: open From gdamore@sun.com Thu Mar 5 08:48:28 2009 Received: from dm-sfbay-02.sfbay.sun.com (dm-sfbay-02.SFBay.Sun.COM [129.146.11.31]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n25GmSFG004697 for ; Thu, 5 Mar 2009 08:48:28 -0800 (PST) Received: from sca-es-mail-1.sun.com (sca-es-mail-1.Sun.COM [192.18.43.132]) by dm-sfbay-02.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n25GmS16054838 for ; Thu, 5 Mar 2009 08:48:28 -0800 (PST) Received: from fe-sfbay-10.sun.com ([192.18.43.129]) by sca-es-mail-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n25GmNbm029762 for ; Thu, 5 Mar 2009 08:48:23 -0800 (PST) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; format=flowed; charset=ISO-8859-1 Received: from conversion-daemon.fe-sfbay-10.sun.com by fe-sfbay-10.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) id <0KG100B00K80WK00@fe-sfbay-10.sun.com> for psarc-ext@sac.sfbay.sun.com; Thu, 05 Mar 2009 08:48:23 -0800 (PST) Received: from [192.168.251.11] ([unknown] [76.93.15.33]) by fe-sfbay-10.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) with ESMTPSA id <0KG10049BLCHSO30@fe-sfbay-10.sun.com>; Thu, 05 Mar 2009 08:48:18 -0800 (PST) Date: Thu, 05 Mar 2009 08:48:17 -0800 From: "Garrett D'Amore" Subject: Re: Integrate LSI MegaRAID SAS2.0 Controller HBA Driver (mr_sas) into Solaris [PSARC 2009/154] In-reply-to: <49AF7750.5000707@sun.com> Sender: Garrett.Damore@sun.com To: Frank Che Cc: psarc-ext@sac.sfbay.sun.com, Susan Scheufele , Yu Wu , lsi-megasas-core@sun.com Message-id: <49B00251.3080204@sun.com> References: <49AF7750.5000707@sun.com> User-Agent: Thunderbird 2.0.0.18 (X11/20081201) Status: RO Content-Length: 5996 I'd like some clarifications: Dos this driver support a set of hardware that is distinct from that supported by megasas? I.e. no overlap between what drivers requiring users to "choose" which driver to use for their hardware, right? I seem to understand that this driver *only* supports drives configured as a RAID, and doesn't support ordinary JBOD uses? So a drive used with this controller can only be used with either megasas or another instance of this driver. Right? -- Garrett Frank Che wrote: > I'm sponsoring this fast track for Susan Scheufele and Yu Wu. > Requested release binding is Patch. Timer is set to Mar 12, 2009. > > -Frank > > 2. Project Summary > > This project integrates LSI MegaRAID SAS2.0 Controller HBA driver, > mr_sas, into Solaris. Requested Release binding is Patch. > > LSI's next generation of SAS2.0 HBA controllers will support a new > driver based on the LSI's MegaRAID Firmware Interface (MFI). > The driver was developed by LSI, and the driver capabilities are > significantly upgraded from the previous generation driver, including > dynamic enumeration, SMP support, Hot Plug for Disk and HBA, tape > pass through, and a related kmdb module. The new driver supports > the LSI SAS2108(Liberator) controller. > > 4. Technical Description: > > 4.1. Details: > > The mr_sas(7d) driver will support LSI's MegaRAID SAS2.0 > controllers, and will not support LSI's SAS1.0 controllers. > The on-disk metadata format is compatible, so that MegaRAID > drives can be moved from SAS1.0 to SAS2.0 controllers without > fear of data loss, and vice versa. > > The mr_sas(7d) driver will be DDI and SCSAv2-complaint, as > much as possible. The driver will provide new functionality compared > to the existing megasas(7d) driver: dynamic enumeration, SMP, > drive hot plug, and a related kmdb module. Additional software > features are planned to be implemented by LSI and Sun in separate > phases over the next year. > > 4.3. In Scope: > > The following features are supported in the initial version > of the driver. > X86 Support - starting with X86 due to limited hardware availability > Sparc Support - available within 2 builds of the X86 support > 64 bit DMA - normal HBA feature, was missing from gen1 driver > initially > Dynamic Enumeration - .conf file not required to attach logical > drives > SMP Enumeration - logical drives may be accessed via a SAS expander > FMA level 2 support - checks for errors on DMA and PIO accesses > Hot Plug of Drives - handled via the LSI management utilities > MSI-X support - for MSI and MSI-X interrupts. > Solaris quiesce - for fastboot support > mdb walker - provides driver-related kmdb info > Expander pass through - for specified SAS expanders > > 4.4. Out of Scope: > > The following features are planned as follow-on enhancements for > the driver. They are not supported in the initial release > of the driver due to time-to-market considerations. > Tape pass through - for specified SAS tape drives > Hot Plug of HBA - first RFE following Sparc, required for blades > SMP Multipathing - requirements need further clarification, > for load balancing and failover > Power Management - LSI is investigating the fw support required > Timeout support - LSI is investigating the fw support required > PCI-E relaxed ordering - verified that the device supports it > kstats - part of follow-on performance work > kmem_cache_alloc - if performance testing warrants its usage > fwflash plugin - firmware upgrade for the card and drives is already > handled via the LSI management utilities > FMA 2.5 support - support for LSI MegaRAID-specific error > conditions, > is already handled via the LSI management utilities > > The following features are not supported with mr_sas(7D): > raidctl plugin - Sun has made a business choice to pass through > the responsibility for the device configuration tools to the > vendor (eg, LSI). There is no "value add" in adding the same > capabilities that LSI provides today. > MPXIO - generically does not work with RAID drivers > JBOD passthrough - no near-term support for this feature is planned > iPort code - only applies if there is JBOD passthrough support > WWN registration of devices - no support for this feature is > planned by LSI for this driver > > 4.5. Interfaces: > > The project exports the following interfaces: > > Interface Name Stability Comments > --------------- --------------- ------------- > mr_sas(7D) Committed Driver name > SUNWmrsas Committed Package name > > > 4.6. Doc Impact: > > A man page will be created for the mr_sas(7d) driver. > > 4.7. Admin/Config Impact: > > The BIOS will be used to create RAID volumes for X86 platforms. > There is a minimal Fcode interface that may be used to create > RAID volumes for Sparc platforms. In addition, LSI's RAID > configuration and management utilities are supported with this > driver, and are available for download from LSI's website. > > 4.8. HA Impact: > > Not supported due to lack of MPXIO, which generically does not > work with hardware RAID drivers. > > 4.10. Packaging & Delivery: > > The mr_sas(7d) driver will be delivered initially on the x86 > architectures, and shortly thereafter on Sparc. The mr_sas(7d) > driver will be included as: > > /kernel/drv/mr_sas > /kernel/drv/mr_sas.conf > /kernel/drv/amd64/mr_sas > /kernel/drv/sparcv9/mr_sas > > The mr_sas(7d) manpage will be included in SUNWman. > > 6. Resources and Schedule: > > 6.4. Product Approval Committee requested information: > 6.4.1. Consolidation or Component Name: ON > > 6.5. ARC review type: Fast Track > > 6.6. ARC Exposure: open > > From Susan.Scheufele@Sun.COM Thu Mar 5 12:47:42 2009 Received: from dm-sfbay-01.sfbay.sun.com (dm-sfbay-01.SFBay.Sun.COM [129.145.155.118]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n25KlgSB015211 for ; Thu, 5 Mar 2009 12:47:42 -0800 (PST) Received: from sca-es-mail-2.sun.com (sca-es-mail-2.Sun.COM [192.18.43.133]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n25KlcZ1044269 for ; Thu, 5 Mar 2009 12:47:38 -0800 (PST) Received: from fe-sfbay-10.sun.com ([192.18.43.129]) by sca-es-mail-2.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n25KlXSh009996 for ; Thu, 5 Mar 2009 12:47:33 -0800 (PST) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; format=flowed; charset=ISO-8859-1 Received: from conversion-daemon.fe-sfbay-10.sun.com by fe-sfbay-10.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) id <0KG100100W5O3B00@fe-sfbay-10.sun.com> for psarc-ext@sac.sfbay.sun.com; Thu, 05 Mar 2009 12:47:33 -0800 (PST) Received: from [129.146.104.159] ([unknown] [129.146.104.159]) by fe-sfbay-10.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) with ESMTPSA id <0KG100BFRWF7Z560@fe-sfbay-10.sun.com>; Thu, 05 Mar 2009 12:47:32 -0800 (PST) Date: Thu, 05 Mar 2009 12:43:47 -0800 From: Susan Scheufele Subject: Re: Integrate LSI MegaRAID SAS2.0 Controller HBA Driver (mr_sas) into Solaris [PSARC 2009/154] In-reply-to: <49B00251.3080204@sun.com> Sender: Susan.Scheufele@Sun.COM To: "Garrett D'Amore" Cc: Frank Che , psarc-ext@sac.sfbay.sun.com, Yu Wu , lsi-megasas-core@Sun.COM Message-id: <49B03983.6070500@Sun.COM> References: <49AF7750.5000707@sun.com> <49B00251.3080204@sun.com> User-Agent: Thunderbird 2.0.0.16 (X11/20080922) Status: RO Content-Length: 6741 Hi Garrett, Garrett D'Amore wrote: > I'd like some clarifications: > > Dos this driver support a set of hardware that is distinct from that > supported by megasas? I.e. no overlap between what drivers requiring > users to "choose" which driver to use for their hardware, right? You are correct, the mr_sas driver supports a set of hardware that is distinct from what is supported by the mega_sas driver. This "gen2" driver supports SAS2.0 hardware (as well as SAS1.0 hardware). There is no overlap between the drivers, and users will not "choose" which driver to use for their hardware. > I seem to understand that this driver *only* supports drives configured > as a RAID, and doesn't support ordinary JBOD uses? This is true. All disks supported by the mr_sas driver will be RAID volumes, even if only RAID 0 or RAID 1. > So a drive used > with this controller can only be used with either megasas or another > instance of this driver. Right? LSI will support migrating MegaRAID drives from the gen1 cards/driver to the gen2 cards/driver, and vice versa. -Susan > -- Garrett > > Frank Che wrote: >> I'm sponsoring this fast track for Susan Scheufele and Yu Wu. >> Requested release binding is Patch. Timer is set to Mar 12, 2009. >> >> -Frank >> >> 2. Project Summary >> >> This project integrates LSI MegaRAID SAS2.0 Controller HBA driver, >> mr_sas, into Solaris. Requested Release binding is Patch. >> >> LSI's next generation of SAS2.0 HBA controllers will support a new >> driver based on the LSI's MegaRAID Firmware Interface (MFI). >> The driver was developed by LSI, and the driver capabilities are >> significantly upgraded from the previous generation driver, including >> dynamic enumeration, SMP support, Hot Plug for Disk and HBA, tape >> pass through, and a related kmdb module. The new driver supports >> the LSI SAS2108(Liberator) controller. >> >> 4. Technical Description: >> >> 4.1. Details: >> >> The mr_sas(7d) driver will support LSI's MegaRAID SAS2.0 >> controllers, and will not support LSI's SAS1.0 controllers. >> The on-disk metadata format is compatible, so that MegaRAID >> drives can be moved from SAS1.0 to SAS2.0 controllers without >> fear of data loss, and vice versa. >> >> The mr_sas(7d) driver will be DDI and SCSAv2-complaint, as >> much as possible. The driver will provide new functionality compared >> to the existing megasas(7d) driver: dynamic enumeration, SMP, >> drive hot plug, and a related kmdb module. Additional software >> features are planned to be implemented by LSI and Sun in separate >> phases over the next year. >> >> 4.3. In Scope: >> >> The following features are supported in the initial version >> of the driver. >> X86 Support - starting with X86 due to limited hardware availability >> Sparc Support - available within 2 builds of the X86 support >> 64 bit DMA - normal HBA feature, was missing from gen1 driver >> initially >> Dynamic Enumeration - .conf file not required to attach logical >> drives >> SMP Enumeration - logical drives may be accessed via a SAS expander >> FMA level 2 support - checks for errors on DMA and PIO accesses >> Hot Plug of Drives - handled via the LSI management utilities >> MSI-X support - for MSI and MSI-X interrupts. >> Solaris quiesce - for fastboot support >> mdb walker - provides driver-related kmdb info >> Expander pass through - for specified SAS expanders >> >> 4.4. Out of Scope: >> >> The following features are planned as follow-on enhancements for >> the driver. They are not supported in the initial release >> of the driver due to time-to-market considerations. >> Tape pass through - for specified SAS tape drives >> Hot Plug of HBA - first RFE following Sparc, required for blades >> SMP Multipathing - requirements need further clarification, >> for load balancing and failover >> Power Management - LSI is investigating the fw support required >> Timeout support - LSI is investigating the fw support required >> PCI-E relaxed ordering - verified that the device supports it >> kstats - part of follow-on performance work >> kmem_cache_alloc - if performance testing warrants its usage >> fwflash plugin - firmware upgrade for the card and drives is already >> handled via the LSI management utilities >> FMA 2.5 support - support for LSI MegaRAID-specific error >> conditions, >> is already handled via the LSI management utilities >> >> The following features are not supported with mr_sas(7D): >> raidctl plugin - Sun has made a business choice to pass through >> the responsibility for the device configuration tools to the >> vendor (eg, LSI). There is no "value add" in adding the same >> capabilities that LSI provides today. >> MPXIO - generically does not work with RAID drivers >> JBOD passthrough - no near-term support for this feature is planned >> iPort code - only applies if there is JBOD passthrough support >> WWN registration of devices - no support for this feature is >> planned by LSI for this driver >> >> 4.5. Interfaces: >> >> The project exports the following interfaces: >> >> Interface Name Stability Comments >> --------------- --------------- ------------- >> mr_sas(7D) Committed Driver name >> SUNWmrsas Committed Package name >> >> >> 4.6. Doc Impact: >> >> A man page will be created for the mr_sas(7d) driver. >> >> 4.7. Admin/Config Impact: >> >> The BIOS will be used to create RAID volumes for X86 platforms. >> There is a minimal Fcode interface that may be used to create >> RAID volumes for Sparc platforms. In addition, LSI's RAID >> configuration and management utilities are supported with this >> driver, and are available for download from LSI's website. >> >> 4.8. HA Impact: >> >> Not supported due to lack of MPXIO, which generically does not >> work with hardware RAID drivers. >> >> 4.10. Packaging & Delivery: >> >> The mr_sas(7d) driver will be delivered initially on the x86 >> architectures, and shortly thereafter on Sparc. The mr_sas(7d) >> driver will be included as: >> >> /kernel/drv/mr_sas >> /kernel/drv/mr_sas.conf >> /kernel/drv/amd64/mr_sas >> /kernel/drv/sparcv9/mr_sas >> >> The mr_sas(7d) manpage will be included in SUNWman. >> >> 6. Resources and Schedule: >> >> 6.4. Product Approval Committee requested information: >> 6.4.1. Consolidation or Component Name: ON >> >> 6.5. ARC review type: Fast Track >> >> 6.6. ARC Exposure: open >> >> > From gdamore@sun.com Thu Mar 5 13:01:45 2009 Received: from dm-sfbay-01.sfbay.sun.com (dm-sfbay-01.SFBay.Sun.COM [129.145.155.118]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id n25L1jsX016450 for ; Thu, 5 Mar 2009 13:01:45 -0800 (PST) Received: from sca-es-mail-1.sun.com (sca-es-mail-1.Sun.COM [192.18.43.132]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id n25L1jr7053612 for ; Thu, 5 Mar 2009 13:01:45 -0800 (PST) Received: from fe-sfbay-10.sun.com ([192.18.43.129]) by sca-es-mail-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id n25L1evw011227 for ; Thu, 5 Mar 2009 13:01:40 -0800 (PST) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; format=flowed; charset=ISO-8859-1 Received: from conversion-daemon.fe-sfbay-10.sun.com by fe-sfbay-10.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) id <0KG100G00WLZZ600@fe-sfbay-10.sun.com> for psarc-ext@sac.sfbay.sun.com; Thu, 05 Mar 2009 13:01:40 -0800 (PST) Received: from [192.168.251.11] ([unknown] [76.93.15.33]) by fe-sfbay-10.sun.com (Sun Java(tm) System Messaging Server 7.0-3.01 64bit (built Dec 23 2008)) with ESMTPSA id <0KG100BUEX2AZ5C0@fe-sfbay-10.sun.com>; Thu, 05 Mar 2009 13:01:23 -0800 (PST) Date: Thu, 05 Mar 2009 13:01:22 -0800 From: "Garrett D'Amore" Subject: Re: Integrate LSI MegaRAID SAS2.0 Controller HBA Driver (mr_sas) into Solaris [PSARC 2009/154] In-reply-to: <49B03983.6070500@Sun.COM> Sender: Garrett.Damore@sun.com To: Susan Scheufele Cc: Frank Che , psarc-ext@sac.sfbay.sun.com, Yu Wu , lsi-megasas-core@sun.com Message-id: <49B03DA2.4010505@sun.com> References: <49AF7750.5000707@sun.com> <49B00251.3080204@sun.com> <49B03983.6070500@Sun.COM> User-Agent: Thunderbird 2.0.0.18 (X11/20081201) Status: RO Content-Length: 7361 Susan Scheufele wrote: > Hi Garrett, > > Garrett D'Amore wrote: >> I'd like some clarifications: >> >> Dos this driver support a set of hardware that is distinct from that >> supported by megasas? I.e. no overlap between what drivers requiring >> users to "choose" which driver to use for their hardware, right? > > You are correct, the mr_sas driver supports a set of hardware that is > distinct from what is supported by the mega_sas driver. This "gen2" > driver supports SAS2.0 hardware (as well as SAS1.0 hardware). There is > no overlap between the drivers, and users will not "choose" which > driver to use for their hardware. > >> I seem to understand that this driver *only* supports drives >> configured as a RAID, and doesn't support ordinary JBOD uses? > > This is true. All disks supported by the mr_sas driver will be RAID > volumes, even if only RAID 0 or RAID 1. > >> So a drive used with this controller can only be used with either >> megasas or another instance of this driver. Right? > > LSI will support migrating MegaRAID drives from the gen1 cards/driver > to the gen2 cards/driver, and vice versa. Understood. The key take away is that these drives are not compatible with "ordinary" SAS controllers from other vendors. (Or rather, any drive content cannot be preserved across such a move.) I'll give this proposal +1, with a gentle "wishlist" item to have the ability to use the drives as JBOD (e.g. for use with ZFS, or because drive portability is important to the user). -- Garrett > > -Susan > >> -- Garrett >> >> Frank Che wrote: >>> I'm sponsoring this fast track for Susan Scheufele and Yu Wu. >>> Requested release binding is Patch. Timer is set to Mar 12, 2009. >>> >>> -Frank >>> >>> 2. Project Summary >>> >>> This project integrates LSI MegaRAID SAS2.0 Controller HBA driver, >>> mr_sas, into Solaris. Requested Release binding is Patch. >>> >>> LSI's next generation of SAS2.0 HBA controllers will support a new >>> driver based on the LSI's MegaRAID Firmware Interface (MFI). >>> The driver was developed by LSI, and the driver capabilities are >>> significantly upgraded from the previous generation driver, including >>> dynamic enumeration, SMP support, Hot Plug for Disk and HBA, tape >>> pass through, and a related kmdb module. The new driver supports >>> the LSI SAS2108(Liberator) controller. >>> >>> 4. Technical Description: >>> >>> 4.1. Details: >>> >>> The mr_sas(7d) driver will support LSI's MegaRAID SAS2.0 >>> controllers, and will not support LSI's SAS1.0 controllers. >>> The on-disk metadata format is compatible, so that MegaRAID >>> drives can be moved from SAS1.0 to SAS2.0 controllers without >>> fear of data loss, and vice versa. >>> >>> The mr_sas(7d) driver will be DDI and SCSAv2-complaint, as >>> much as possible. The driver will provide new functionality compared >>> to the existing megasas(7d) driver: dynamic enumeration, SMP, >>> drive hot plug, and a related kmdb module. Additional software >>> features are planned to be implemented by LSI and Sun in separate >>> phases over the next year. >>> >>> 4.3. In Scope: >>> >>> The following features are supported in the initial version >>> of the driver. >>> X86 Support - starting with X86 due to limited hardware >>> availability >>> Sparc Support - available within 2 builds of the X86 support >>> 64 bit DMA - normal HBA feature, was missing from gen1 driver >>> initially >>> Dynamic Enumeration - .conf file not required to attach logical >>> drives >>> SMP Enumeration - logical drives may be accessed via a SAS >>> expander >>> FMA level 2 support - checks for errors on DMA and PIO accesses >>> Hot Plug of Drives - handled via the LSI management utilities >>> MSI-X support - for MSI and MSI-X interrupts. >>> Solaris quiesce - for fastboot support >>> mdb walker - provides driver-related kmdb info >>> Expander pass through - for specified SAS expanders >>> >>> 4.4. Out of Scope: >>> >>> The following features are planned as follow-on enhancements for >>> the driver. They are not supported in the initial release >>> of the driver due to time-to-market considerations. >>> Tape pass through - for specified SAS tape drives >>> Hot Plug of HBA - first RFE following Sparc, required for blades >>> SMP Multipathing - requirements need further clarification, >>> for load balancing and failover >>> Power Management - LSI is investigating the fw support required >>> Timeout support - LSI is investigating the fw support required >>> PCI-E relaxed ordering - verified that the device supports it >>> kstats - part of follow-on performance work >>> kmem_cache_alloc - if performance testing warrants its usage >>> fwflash plugin - firmware upgrade for the card and drives is >>> already >>> handled via the LSI management utilities >>> FMA 2.5 support - support for LSI MegaRAID-specific error >>> conditions, >>> is already handled via the LSI management utilities >>> >>> The following features are not supported with mr_sas(7D): >>> raidctl plugin - Sun has made a business choice to pass through >>> the responsibility for the device configuration tools to the >>> vendor (eg, LSI). There is no "value add" in adding the same >>> capabilities that LSI provides today. >>> MPXIO - generically does not work with RAID drivers >>> JBOD passthrough - no near-term support for this feature is >>> planned >>> iPort code - only applies if there is JBOD passthrough support >>> WWN registration of devices - no support for this feature is >>> planned by LSI for this driver >>> >>> 4.5. Interfaces: >>> >>> The project exports the following interfaces: >>> >>> Interface Name Stability Comments >>> --------------- --------------- ------------- >>> mr_sas(7D) Committed Driver name >>> SUNWmrsas Committed Package name >>> >>> >>> 4.6. Doc Impact: >>> >>> A man page will be created for the mr_sas(7d) driver. >>> >>> 4.7. Admin/Config Impact: >>> >>> The BIOS will be used to create RAID volumes for X86 platforms. >>> There is a minimal Fcode interface that may be used to create >>> RAID volumes for Sparc platforms. In addition, LSI's RAID >>> configuration and management utilities are supported with this >>> driver, and are available for download from LSI's website. >>> >>> 4.8. HA Impact: >>> >>> Not supported due to lack of MPXIO, which generically does not >>> work with hardware RAID drivers. >>> >>> 4.10. Packaging & Delivery: >>> >>> The mr_sas(7d) driver will be delivered initially on the x86 >>> architectures, and shortly thereafter on Sparc. The mr_sas(7d) >>> driver will be included as: >>> >>> /kernel/drv/mr_sas >>> /kernel/drv/mr_sas.conf >>> /kernel/drv/amd64/mr_sas >>> /kernel/drv/sparcv9/mr_sas >>> >>> The mr_sas(7d) manpage will be included in SUNWman. >>> >>> 6. Resources and Schedule: >>> >>> 6.4. Product Approval Committee requested information: >>> 6.4.1. Consolidation or Component Name: ON >>> >>> 6.5. ARC review type: Fast Track >>> >>> 6.6. ARC Exposure: open >>> >>> >> >