From johnf@sac.sfbay.sun.com Fri Oct 31 09:04:26 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m9VG4Qtu022090 for ; Fri, 31 Oct 2008 09:04:26 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m9VG4A8W003631; Fri, 31 Oct 2008 16:04:25 GMT Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K9M00M071ZCD400@nwk-avmta-1.sfbay.Sun.COM>; Fri, 31 Oct 2008 09:04:24 -0700 (PDT) Received: from dm-sfbay-01.sfbay.sun.com ([129.145.155.118]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K9M00DFE1ZBHNA0@nwk-avmta-1.sfbay.Sun.COM>; Fri, 31 Oct 2008 09:04:23 -0700 (PDT) Received: from sac.sfbay.sun.com (new-sac.SFBay.Sun.COM [129.146.175.65]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m9VG4NoS011983; Fri, 31 Oct 2008 09:04:23 -0700 (PDT) Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m9VG4MkM022085; Fri, 31 Oct 2008 09:04:22 -0700 (PDT) Received: (from johnf@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id m9VG4MMa022081; Fri, 31 Oct 2008 09:04:22 -0700 (PDT) Date: Fri, 31 Oct 2008 09:04:22 -0700 (PDT) From: John Fischer Subject: Twisted update to 8.1 and adding Twisted-Web2 [PSARC/2008/670 FastTrack timeout 11/07/2008] To: PSARC-ext@sun.com Cc: brian.cameron@sun.com, john.fischer@sun.com Message-id: <200810311604.m9VG4MMa022081@sac.sfbay.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 9964 Template Version: @(#)sac_nextcase %I% %G% SMI This information is Copyright 2008 Sun Microsystems 1. Introduction 1.1. Project/Component Working Name: Twisted update to 8.1 and adding Twisted-Web2 1.2. Name of Document Author/Supplier: Author: Brian Cameron 1.3 Date of This Document: 31 October, 2008 4. Technical Description 1. Introduction 1.1. Project/Component Working Name: Twisted update to 8.1 and adding Twisted-Web2 1.2. Name of Document Author/Supplier: Brian Cameron 1.3. Date of This Document: 10/28/2008 1.4. Name of Major Document Customer(s)/Consumer(s): 1.4.1. The PAC or CPT you expect to review your project: Solaris PAC 1.4.2. The ARC(s) you expect to review your project: LSARC 1.4.3. The Director/VP who is "Sponsoring" this project: Robert O'Dea 1.4.4. The name of your business unit: Software - OPG 1.5. Email Aliases: 1.5.1. Responsible Manager: leo.binchy@sun.com 1.5.2. Responsible Engineer: brian.cameron@sun.com, 1.5.3 Marketing Manager: dan.robert@sun.com 1.5.4. Interest List: desktop-discuss@opensolaris.org 2. Project Summary 2.1. Project Description: This project updates Twisted from 2.5 to 8.1 and adds the Twisted.Web2 module. 4. Technical Description: 4.1. Details: Twisted is a popular, open-source networking engine written in Python and supporting numerous protocols. It contains a web server, chat clients, chat servers, mail servers, and more. Twisted is made up of a number of related sub-projects. This proposal integrates version 8.1 which includes the following 9 main modules: Twisted Conch SSH and SFTP protocol implementation. Twisted Core Asynchronous event loop. Twisted Lore Documentation generator with HTML and LaTeX support. Twisted Mail SMTP, IMAP and POP protocol implementation. Twisted Names DNS protocol implementation with client and server. Twisted News NNTP protocol implementation with client and server. Twisted Runner Process management, including an inetd server. Twisted Web HTTP protocol implementation with clients and servers. Twisted Words Chat and Instant Messaging. The Web2 module is a 10th module which is distributed separately. 4.1.1. Updating Python Twisted from 2.5 to 8.1 While this may seem like a fairly significant version bump, it is not. The Twisted community changed their version numbering system so that the first digit of the version is the last digit of the year. Release 2.5 was followed by release 8.0 and then 8.1. So, the Twisted community is not following normal major.minor.micro version numbering system used by most software. Python Twisted 2.5 was previously reviewed as PSARC 2008/121. Twisted version 8.1 contains many bug fixes. The following highlights the more significant interface-related features and deprecations. All features were relate to Twisted release 8.0 unless otherwise specified: - Twisted now uses setuptools and easy_install for better installation. - twisted.internet.defer contains a DeferredFilesystemLock which gives a Deferred interface to lock file acquisition. - twisted.python.modules is a new system for representing and manipulated module paths (i.e. sys.path). - twisted.internet.fdesc now contains a writeToFD function. - The reactor now has a blockingCallFromThread method for non-reactor threads to use to wait for a reactor-scheduled call to return a result. - twisted.internet.task.deferLater is a new API for scheduling calls and getting deferreds which are fired with their results. - twisted.python.log now contains a Twisted log observer which can forward messages to the Python logging system. - Log files now include seconds in the timestamps. - Int8Receiver was added. - The FTP client can be told what port range to bind passive transfer ports. - twisted.spread.jelly now supports decimal objects and all forms of sets. - Twisted Conch adds DEC private mode manipulation methods to ITerminalTransport. - Twisted Web twisted.web.client.getPage has support for the HTTP HEAD method. - Twisted Words provides a function for creating XMPP response stanzas. - Twisted Words adds 'and' and 'or' operators for Xish Xpath expressions. - Twisted Mail supports CAPABILITY responses that include atoms of the form "FOO" and "FOO=BAR" in IMAP4 - In 8.1, twisted.internet.error.ConnectionClosed is a new exception which is the superclass of ConnectionLost and ConnectionDone. - In 8.1, extending XMPP protocols is easier. Deprecations: - twisted.python.timeoutqueue. - twisted.entrprise.row, twisted.enterprise.reflector, and twisted.enterprise.util. - The dispatch and dispatchWithCallback methods of ThreadPool. - Starting the same reactor multiple times. - The visit method of various test classes in trial. - The --report-profile option to twistd and twisted.python.dxprofile. - The upDownError method of Trail reporters. - In 8.1, mktap is now deprecated. 4.1.2. Twisted.Web2 This case also adds the Twisted.Web2 module. This is an asynchronous HTTP 1.1 Web Server Framework built with Twisted. It provides a RFC 2616 compliant HTTP 1.1 protocol implementation, with pipelined and persistent request support, in a non-blocking threadless manner. It also includes a simple web framework with request and response objects, static file support, error handling, form upload support, HTTP range support, pre-built parsers for all standard headers, and so on. It is deployable as a standalone HTTP or HTTPS server, as a HTTP[S] server proxied behind another server, or as a SCGI, FastCGI, or CGI script. In addition to running native twisted.web2 applications, it can also run any WSGI or CGI application, or, via compatibility wrappers, most applications written for the older twisted.web API. Currently, twisted.web2 does not include a HTTP client or proxy. Twisted.web2 is not a templating framework. It provides mechanisms for locating and running code associated with a URL, but does not provide any means for separating code and data or to ease the task of generating HTML. According to its documentation, its interfaces should not be considered stable. Note that Python-Twisted contains a module named Web, which is a separate project and there is no compatibility between them. The Twisted.Web2 module has the following improvements over Twisted.Web: * Streaming upload data * Support for multiple headers of the same name * Separation of low level HTTP and high level request handling which allows it to run under other transports such as SCGI and CGI * IResource API improvements from Nevow * More versatile outgoing data streaming API * Correct header parsing * Full HTTP/1.1 support * Output filters (HTTP range support in a generic fashion, and gzip support) * Significantly better URI Rewriting when used behind a reverse proxy such as Apache's mod_pxy 4.2. Interfaces: Exported interfaces: Interface Stability Comment -------------------------------------- -------------- --------------------- twisted.flow Uncommitted Python Twisted module twisted.pair Uncommitted Python Twisted module twisted.web2 Uncommitted Python Twisted Web2 module Imported Interfaces Interface Stability Comments -------------------------------------- -------------- --------------------- Python 2.4.x External PSARC 2005/532 Python Setuptools Uncommitted PSARC 2008/084 zope-interface Uncommitted PSARC 2008/122 4.3. Doc Impact: Man page is needed. 4.4. Packaging & Delivery: SUNWpython-twisted - package for Python-Twisted SUNWpython-twisted-web2 - package for Python-Twisted-Web2 4.5. Dependencies: None. 4.6. L10N Impact: The Desktop team and the G11N are working together to evaluate and provide I18N/L10N support. 4.7 Security Impact: None. 5. Reference Documents: PSARC 2008/121 Python Twisted. Python Twisted Home Page http://twistedmatrix.com/trac/ Twisted Documentation http://twistedmatrix.com/projects/core/documentation/howto/index.html http://twistedmatrix.com/trac/wiki/Documentation 6. Resources and Schedule 6.4. Steering Committee requested information 6.4.1. Consolidation C-team Name: JDS - Gnome 6.5. ARC review type: FastTrack 6.6. ARC Exposure: open From johnf@sac.sfbay.sun.com Fri Oct 31 09:09:26 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m9VG9P5b022651 for ; Fri, 31 Oct 2008 09:09:25 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m9VG9Lpm005908 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Fri, 31 Oct 2008 16:09:24 GMT Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K9M00M0527NSX00@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Fri, 31 Oct 2008 09:09:23 -0700 (PDT) Received: from dm-sfbay-02.sfbay.sun.com ([129.146.11.31]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K9M00DQ927MHSA0@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Fri, 31 Oct 2008 09:09:22 -0700 (PDT) Received: from sac.sfbay.sun.com (new-sac.SFBay.Sun.COM [129.146.175.65]) by dm-sfbay-02.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id m9VG9M7r017853; Fri, 31 Oct 2008 09:09:22 -0700 (PDT) Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id m9VG9MRD022649; Fri, 31 Oct 2008 09:09:22 -0700 (PDT) Received: (from johnf@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id m9VG9Mg2022648; Fri, 31 Oct 2008 09:09:22 -0700 (PDT) Date: Fri, 31 Oct 2008 09:09:22 -0700 (PDT) From: John Fischer Subject: Re: Twisted update to 8.1 and adding Twisted-Web2 [PSARC/2008/670 FastTrack timeout 11/07/2008] To: PSARC-ext@sun.com, johnf@sac.sfbay.sun.com Cc: brian.cameron@sun.com Message-id: <200810311609.m9VG9Mg2022648@sac.sfbay.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 9957 All, I am sponsoring this case for Brian Cameron from the Desktop group in Ireland (he is in Chicago). The case directory contains this proposal. I have set the time out for Friday, November 11, 2008. This project proposes to integrate into a Minor release of Solaris version 8.1 of the Twisted Python project. Twisted version 5.2 was already approved in PSARC 2008/121. The community has changed the numbering scheme for the project and this should still be considered a minor release of the Twisted project. Thanks, John 1. Introduction 1.1. Project/Component Working Name: Twisted update to 8.1 and adding Twisted-Web2 1.2. Name of Document Author/Supplier: Brian Cameron 1.3. Date of This Document: 10/28/2008 1.4. Name of Major Document Customer(s)/Consumer(s): 1.4.1. The PAC or CPT you expect to review your project: Solaris PAC 1.4.2. The ARC(s) you expect to review your project: LSARC 1.4.3. The Director/VP who is "Sponsoring" this project: Robert O'Dea 1.4.4. The name of your business unit: Software - OPG 1.5. Email Aliases: 1.5.1. Responsible Manager: leo.binchy@sun.com 1.5.2. Responsible Engineer: brian.cameron@sun.com, 1.5.3 Marketing Manager: dan.robert@sun.com 1.5.4. Interest List: desktop-discuss@opensolaris.org 2. Project Summary 2.1. Project Description: This project updates Twisted from 2.5 to 8.1 and adds the Twisted.Web2 module. 4. Technical Description: 4.1. Details: Twisted is a popular, open-source networking engine written in Python and supporting numerous protocols. It contains a web server, chat clients, chat servers, mail servers, and more. Twisted is made up of a number of related sub-projects. This proposal integrates version 8.1 which includes the following 9 main modules: Twisted Conch SSH and SFTP protocol implementation. Twisted Core Asynchronous event loop. Twisted Lore Documentation generator with HTML and LaTeX support. Twisted Mail SMTP, IMAP and POP protocol implementation. Twisted Names DNS protocol implementation with client and server. Twisted News NNTP protocol implementation with client and server. Twisted Runner Process management, including an inetd server. Twisted Web HTTP protocol implementation with clients and servers. Twisted Words Chat and Instant Messaging. The Web2 module is a 10th module which is distributed separately. 4.1.1. Updating Python Twisted from 2.5 to 8.1 While this may seem like a fairly significant version bump, it is not. The Twisted community changed their version numbering system so that the first digit of the version is the last digit of the year. Release 2.5 was followed by release 8.0 and then 8.1. So, the Twisted community is not following normal major.minor.micro version numbering system used by most software. Python Twisted 2.5 was previously reviewed as PSARC 2008/121. Twisted version 8.1 contains many bug fixes. The following highlights the more significant interface-related features and deprecations. All features were relate to Twisted release 8.0 unless otherwise specified: - Twisted now uses setuptools and easy_install for better installation. - twisted.internet.defer contains a DeferredFilesystemLock which gives a Deferred interface to lock file acquisition. - twisted.python.modules is a new system for representing and manipulated module paths (i.e. sys.path). - twisted.internet.fdesc now contains a writeToFD function. - The reactor now has a blockingCallFromThread method for non-reactor threads to use to wait for a reactor-scheduled call to return a result. - twisted.internet.task.deferLater is a new API for scheduling calls and getting deferreds which are fired with their results. - twisted.python.log now contains a Twisted log observer which can forward messages to the Python logging system. - Log files now include seconds in the timestamps. - Int8Receiver was added. - The FTP client can be told what port range to bind passive transfer ports. - twisted.spread.jelly now supports decimal objects and all forms of sets. - Twisted Conch adds DEC private mode manipulation methods to ITerminalTransport. - Twisted Web twisted.web.client.getPage has support for the HTTP HEAD method. - Twisted Words provides a function for creating XMPP response stanzas. - Twisted Words adds 'and' and 'or' operators for Xish Xpath expressions. - Twisted Mail supports CAPABILITY responses that include atoms of the form "FOO" and "FOO=BAR" in IMAP4 - In 8.1, twisted.internet.error.ConnectionClosed is a new exception which is the superclass of ConnectionLost and ConnectionDone. - In 8.1, extending XMPP protocols is easier. Deprecations: - twisted.python.timeoutqueue. - twisted.entrprise.row, twisted.enterprise.reflector, and twisted.enterprise.util. - The dispatch and dispatchWithCallback methods of ThreadPool. - Starting the same reactor multiple times. - The visit method of various test classes in trial. - The --report-profile option to twistd and twisted.python.dxprofile. - The upDownError method of Trail reporters. - In 8.1, mktap is now deprecated. 4.1.2. Twisted.Web2 This case also adds the Twisted.Web2 module. This is an asynchronous HTTP 1.1 Web Server Framework built with Twisted. It provides a RFC 2616 compliant HTTP 1.1 protocol implementation, with pipelined and persistent request support, in a non-blocking threadless manner. It also includes a simple web framework with request and response objects, static file support, error handling, form upload support, HTTP range support, pre-built parsers for all standard headers, and so on. It is deployable as a standalone HTTP or HTTPS server, as a HTTP[S] server proxied behind another server, or as a SCGI, FastCGI, or CGI script. In addition to running native twisted.web2 applications, it can also run any WSGI or CGI application, or, via compatibility wrappers, most applications written for the older twisted.web API. Currently, twisted.web2 does not include a HTTP client or proxy. Twisted.web2 is not a templating framework. It provides mechanisms for locating and running code associated with a URL, but does not provide any means for separating code and data or to ease the task of generating HTML. According to its documentation, its interfaces should not be considered stable. Note that Python-Twisted contains a module named Web, which is a separate project and there is no compatibility between them. The Twisted.Web2 module has the following improvements over Twisted.Web: * Streaming upload data * Support for multiple headers of the same name * Separation of low level HTTP and high level request handling which allows it to run under other transports such as SCGI and CGI * IResource API improvements from Nevow * More versatile outgoing data streaming API * Correct header parsing * Full HTTP/1.1 support * Output filters (HTTP range support in a generic fashion, and gzip support) * Significantly better URI Rewriting when used behind a reverse proxy such as Apache's mod_pxy 4.2. Interfaces: Exported interfaces: Interface Stability Comment -------------------------------------- -------------- --------------------- twisted.flow Uncommitted Python Twisted module twisted.pair Uncommitted Python Twisted module twisted.web2 Uncommitted Python Twisted Web2 module Imported Interfaces Interface Stability Comments -------------------------------------- -------------- --------------------- Python 2.4.x External PSARC 2005/532 Python Setuptools Uncommitted PSARC 2008/084 zope-interface Uncommitted PSARC 2008/122 4.3. Doc Impact: Man page is needed. 4.4. Packaging & Delivery: SUNWpython-twisted - package for Python-Twisted SUNWpython-twisted-web2 - package for Python-Twisted-Web2 4.5. Dependencies: None. 4.6. L10N Impact: The Desktop team and the G11N are working together to evaluate and provide I18N/L10N support. 4.7 Security Impact: None. 5. Reference Documents: PSARC 2008/121 Python Twisted. Python Twisted Home Page http://twistedmatrix.com/trac/ Twisted Documentation http://twistedmatrix.com/projects/core/documentation/howto/index.html http://twistedmatrix.com/trac/wiki/Documentation From Brian.Cameron@sun.com Fri Oct 31 22:02:48 2008 Received: from newsunmail1brm.central.sun.com (newsunmail1brm.Central.Sun.COM [129.147.62.245]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mA152mFL012800 for ; Fri, 31 Oct 2008 22:02:48 -0700 (PDT) Received: from nwk-avmta-1.SFBay.Sun.COM (nwk-avmta-1.SFBay.Sun.COM [129.146.11.74]) by newsunmail1brm.central.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id mA152duC016683 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Fri, 31 Oct 2008 23:02:48 -0600 (MDT) Received: from pmxchannel-daemon.nwk-avmta-1.sfbay.Sun.COM by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K9N00G5N20LEF00@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Fri, 31 Oct 2008 22:02:45 -0700 (PDT) Received: from brmea-mail-2.sun.com ([192.18.98.43]) by nwk-avmta-1.sfbay.Sun.COM (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K9N00AP91UD9320@nwk-avmta-1.sfbay.Sun.COM> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Fri, 31 Oct 2008 21:59:01 -0700 (PDT) Received: from fe-amer-10.sun.com ([192.18.109.80]) by brmea-mail-2.sun.com (8.13.6+Sun/8.12.9) with ESMTP id mA14x04F012964 for ; Sat, 01 Nov 2008 04:59:00 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0K9N00A011LYDD00@mail-amer.sun.com> (original mail from Brian.Cameron@Sun.COM) for PSARC-ext@Sun.Com (ORCPT PSARC-ext@Sun.Com); Fri, 31 Oct 2008 22:59:00 -0600 (MDT) Received: from [10.128.0.12] ([218.30.180.194]) by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0K9N00IV41UAGG60@mail-amer.sun.com>; Fri, 31 Oct 2008 22:59:00 -0600 (MDT) Date: Fri, 31 Oct 2008 21:58:57 -0700 From: Brian Cameron Subject: Re: Twisted update to 8.1 and adding Twisted-Web2 [PSARC/2008/670 FastTrack timeout 11/07/2008] In-reply-to: <200810311609.m9VG9Mg2022648@sac.sfbay.sun.com> Sender: Brian.Cameron@sun.com To: John Fischer Cc: PSARC-ext@sun.com Message-id: <490BE211.7040304@sun.com> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200810311609.m9VG9Mg2022648@sac.sfbay.sun.com> User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) Status: RO Content-Length: 10145 John: > This project proposes to integrate into a Minor release of Solaris > version 8.1 of the Twisted Python project. Twisted version 5.2 > was already approved in PSARC 2008/121. You mean to say Twisted version 2.5 instead of 5.2. The previous release was 2.5. Brian > 1. Introduction > > 1.1. Project/Component Working Name: > > Twisted update to 8.1 and adding Twisted-Web2 > > 1.2. Name of Document Author/Supplier: > > Brian Cameron > > 1.3. Date of This Document: > > 10/28/2008 > > 1.4. Name of Major Document Customer(s)/Consumer(s): > 1.4.1. The PAC or CPT you expect to review your project: > > Solaris PAC > > 1.4.2. The ARC(s) you expect to review your project: > > LSARC > > 1.4.3. The Director/VP who is "Sponsoring" this project: > > Robert O'Dea > > 1.4.4. The name of your business unit: > > Software - OPG > > 1.5. Email Aliases: > 1.5.1. Responsible Manager: leo.binchy@sun.com > 1.5.2. Responsible Engineer: brian.cameron@sun.com, > 1.5.3 Marketing Manager: dan.robert@sun.com > 1.5.4. Interest List: desktop-discuss@opensolaris.org > > 2. Project Summary > 2.1. Project Description: > > This project updates Twisted from 2.5 to 8.1 and adds the Twisted.Web2 > module. > > 4. Technical Description: > 4.1. Details: > > Twisted is a popular, open-source networking engine written in Python > and supporting numerous protocols. It contains a web server, chat > clients, chat servers, mail servers, and more. > > Twisted is made up of a number of related sub-projects. This proposal > integrates version 8.1 which includes the following 9 main modules: > > Twisted Conch SSH and SFTP protocol implementation. > Twisted Core Asynchronous event loop. > Twisted Lore Documentation generator with HTML and LaTeX support. > Twisted Mail SMTP, IMAP and POP protocol implementation. > Twisted Names DNS protocol implementation with client and server. > Twisted News NNTP protocol implementation with client and server. > Twisted Runner Process management, including an inetd server. > Twisted Web HTTP protocol implementation with clients and servers. > Twisted Words Chat and Instant Messaging. > > The Web2 module is a 10th module which is distributed separately. > > 4.1.1. Updating Python Twisted from 2.5 to 8.1 > > While this may seem like a fairly significant version bump, it is > not. The Twisted community changed their version numbering system so > that the first digit of the version is the last digit of the year. > Release 2.5 was followed by release 8.0 and then 8.1. So, the > Twisted community is not following normal major.minor.micro version > numbering system used by most software. Python Twisted 2.5 was > previously reviewed as PSARC 2008/121. > > Twisted version 8.1 contains many bug fixes. The following > highlights the more significant interface-related features and > deprecations. All features were relate to Twisted release 8.0 unless > otherwise specified: > > - Twisted now uses setuptools and easy_install for better > installation. > - twisted.internet.defer contains a DeferredFilesystemLock which > gives a Deferred interface to lock file acquisition. > - twisted.python.modules is a new system for representing and > manipulated module paths (i.e. sys.path). > - twisted.internet.fdesc now contains a writeToFD function. > - The reactor now has a blockingCallFromThread method for non-reactor > threads to use to wait for a reactor-scheduled call to return a > result. > - twisted.internet.task.deferLater is a new API for scheduling calls > and getting deferreds which are fired with their results. > - twisted.python.log now contains a Twisted log observer which can > forward messages to the Python logging system. > - Log files now include seconds in the timestamps. > - Int8Receiver was added. > - The FTP client can be told what port range to bind passive transfer > ports. > - twisted.spread.jelly now supports decimal objects and all forms of > sets. > - Twisted Conch adds DEC private mode manipulation methods to > ITerminalTransport. > - Twisted Web twisted.web.client.getPage has support for the HTTP HEAD > method. > - Twisted Words provides a function for creating XMPP response > stanzas. > - Twisted Words adds 'and' and 'or' operators for Xish Xpath > expressions. > - Twisted Mail supports CAPABILITY responses that include atoms of > the form "FOO" and "FOO=BAR" in IMAP4 > - In 8.1, twisted.internet.error.ConnectionClosed is a new exception > which is the superclass of ConnectionLost and ConnectionDone. > - In 8.1, extending XMPP protocols is easier. > > Deprecations: > > - twisted.python.timeoutqueue. > - twisted.entrprise.row, twisted.enterprise.reflector, and > twisted.enterprise.util. > - The dispatch and dispatchWithCallback methods of ThreadPool. > - Starting the same reactor multiple times. > - The visit method of various test classes in trial. > - The --report-profile option to twistd and twisted.python.dxprofile. > - The upDownError method of Trail reporters. > - In 8.1, mktap is now deprecated. > > 4.1.2. Twisted.Web2 > > This case also adds the Twisted.Web2 module. This is an asynchronous > HTTP 1.1 Web Server Framework built with Twisted. It provides a RFC > 2616 compliant HTTP 1.1 protocol implementation, with pipelined and > persistent request support, in a non-blocking threadless manner. > > It also includes a simple web framework with request and response > objects, static file support, error handling, form upload support, > HTTP range support, pre-built parsers for all standard headers, and > so on. > > It is deployable as a standalone HTTP or HTTPS server, as a HTTP[S] > server proxied behind another server, or as a SCGI, FastCGI, or CGI > script. > > In addition to running native twisted.web2 applications, it can also > run any WSGI or CGI application, or, via compatibility wrappers, most > applications written for the older twisted.web API. > > Currently, twisted.web2 does not include a HTTP client or proxy. > > Twisted.web2 is not a templating framework. It provides mechanisms > for locating and running code associated with a URL, but does not > provide any means for separating code and data or to ease the task of > generating HTML. > > According to its documentation, its interfaces should not be > considered stable. Note that Python-Twisted contains a module named > Web, which is a separate project and there is no compatibility > between them. The Twisted.Web2 module has the following improvements > over Twisted.Web: > > * Streaming upload data > * Support for multiple headers of the same name > * Separation of low level HTTP and high level request handling which > allows it to run under other transports such as SCGI and CGI > * IResource API improvements from Nevow > * More versatile outgoing data streaming API > * Correct header parsing > * Full HTTP/1.1 support > * Output filters (HTTP range support in a generic fashion, and gzip > support) > * Significantly better URI Rewriting when used behind a reverse proxy > such as Apache's mod_pxy > > 4.2. Interfaces: > > Exported interfaces: > > Interface Stability Comment > -------------------------------------- -------------- --------------------- > twisted.flow Uncommitted Python Twisted module > twisted.pair Uncommitted Python Twisted module > twisted.web2 Uncommitted Python Twisted Web2 > module > Imported Interfaces > Interface Stability Comments > -------------------------------------- -------------- --------------------- > Python 2.4.x External PSARC 2005/532 > Python Setuptools Uncommitted PSARC 2008/084 > zope-interface Uncommitted PSARC 2008/122 > > 4.3. Doc Impact: > > Man page is needed. > > 4.4. Packaging & Delivery: > > SUNWpython-twisted - package for Python-Twisted > SUNWpython-twisted-web2 - package for Python-Twisted-Web2 > > 4.5. Dependencies: > > None. > > 4.6. L10N Impact: > > The Desktop team and the G11N are working together to evaluate and > provide I18N/L10N support. > > 4.7 Security Impact: > > None. > > 5. Reference Documents: > > PSARC 2008/121 Python Twisted. > > Python Twisted Home Page > http://twistedmatrix.com/trac/ > > Twisted Documentation > http://twistedmatrix.com/projects/core/documentation/howto/index.html > http://twistedmatrix.com/trac/wiki/Documentation > From Alan.Coopersmith@sun.com Mon Nov 3 09:05:23 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mA3H5Mkq010076 for ; Mon, 3 Nov 2008 09:05:22 -0800 (PST) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id mA3H4wQU012404 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Mon, 3 Nov 2008 17:05:21 GMT Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K9R00A1FOSWKM00@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Mon, 03 Nov 2008 09:05:20 -0800 (PST) Received: from sca-es-mail-1.sun.com ([192.18.43.132]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K9R009KOOSU0N80@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Mon, 03 Nov 2008 09:05:18 -0800 (PST) Received: from fe-sfbay-09.sun.com ([192.18.43.129]) by sca-es-mail-1.sun.com (8.13.7+Sun/8.12.9) with ESMTP id mA3H5InG028166 for ; Mon, 03 Nov 2008 09:05:18 -0800 (PST) Received: from conversion-daemon.fe-sfbay-09.sun.com by fe-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0K9R00M01O1XKV00@fe-sfbay-09.sun.com> (original mail from Alan.Coopersmith@Sun.COM) for PSARC-ext@Sun.Com (ORCPT PSARC-ext@Sun.Com); Mon, 03 Nov 2008 09:05:18 -0800 (PST) Received: from [10.6.102.118] by fe-sfbay-09.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0K9R00ALVOST8150@fe-sfbay-09.sun.com>; Mon, 03 Nov 2008 09:05:18 -0800 (PST) Date: Mon, 03 Nov 2008 09:05:17 -0800 From: Alan Coopersmith Subject: Re: Twisted update to 8.1 and adding Twisted-Web2 [PSARC/2008/670 FastTrack timeout 11/07/2008] In-reply-to: <200810311604.m9VG4MMa022081@sac.sfbay.sun.com> Sender: Alan.Coopersmith@sun.com To: John Fischer Cc: PSARC-ext@sun.com, Brian.Cameron@sun.com, John.Fischer@sun.com Message-id: <490F2F4D.2000303@sun.com> MIME-version: 1.0 Content-type: text/plain; charset=UTF-8 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 X-Enigmail-Version: 0.95.1 References: <200810311604.m9VG4MMa022081@sac.sfbay.sun.com> User-Agent: Thunderbird 2.0.0.6 (X11/20071119) Status: RO Content-Length: 581 John Fischer wrote: > While this may seem like a fairly significant version bump, it is > not. The Twisted community changed their version numbering system so > that the first digit of the version is the last digit of the year. > Release 2.5 was followed by release 8.0 and then 8.1. Just had to ask, though not strictly part of this case: Last digit or last two digits? (i.e. in two years will they release 10.0 or 0.0?) -- -Alan Coopersmith- alan.coopersmith@sun.com Sun Microsystems, Inc. - X Window System Engineering From Brian.Cameron@sun.com Mon Nov 3 23:28:46 2008 Received: from sunmail5.uk.sun.com (sunmail5.UK.Sun.COM [129.156.85.165]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mA47SjEk006135 for ; Mon, 3 Nov 2008 23:28:45 -0800 (PST) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail5.uk.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id mA47SY7q017660 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Tue, 4 Nov 2008 07:28:44 GMT Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K9S00403SRUQ300@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Mon, 03 Nov 2008 23:28:42 -0800 (PST) Received: from brmea-mail-4.sun.com ([192.18.98.36]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K9S001IASRUDBC0@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@Sun.Com); Mon, 03 Nov 2008 23:28:42 -0800 (PST) Received: from fe-amer-10.sun.com ([192.18.109.80]) by brmea-mail-4.sun.com (8.13.6+Sun/8.12.9) with ESMTP id mA47SfXn023951 for ; Tue, 04 Nov 2008 07:28:41 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0K9S00D01SM7ZW00@mail-amer.sun.com> (original mail from Brian.Cameron@Sun.COM) for PSARC-ext@Sun.Com (ORCPT PSARC-ext@Sun.Com); Tue, 04 Nov 2008 00:28:41 -0700 (MST) Received: from [192.168.1.104] ([67.167.207.170]) by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0K9S00J0QSRTMC80@mail-amer.sun.com>; Tue, 04 Nov 2008 00:28:41 -0700 (MST) Date: Tue, 04 Nov 2008 01:28:13 -0600 From: Brian Cameron Subject: Re: Twisted update to 8.1 and adding Twisted-Web2 [PSARC/2008/670 FastTrack timeout 11/07/2008] In-reply-to: <490F2F4D.2000303@sun.com> Sender: Brian.Cameron@sun.com To: Alan Coopersmith Cc: John Fischer , PSARC-ext@sun.com, John.Fischer@sun.com Message-id: <490FF98D.1020007@sun.com> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=UTF-8 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200810311604.m9VG4MMa022081@sac.sfbay.sun.com> <490F2F4D.2000303@sun.com> User-Agent: Thunderbird 2.0.0.16 (X11/20080922) Status: RO Content-Length: 861 Alan: > John Fischer wrote: >> While this may seem like a fairly significant version bump, it is >> not. The Twisted community changed their version numbering system so >> that the first digit of the version is the last digit of the year. >> Release 2.5 was followed by release 8.0 and then 8.1. > > Just had to ask, though not strictly part of this case: Last digit or last two > digits? (i.e. in two years will they release 10.0 or 0.0?) Let's check the Twisted 8.0 announcement, which explains a bit about the version number change. http://labs.twistedmatrix.com/2008/03/twisted-80-released.html They seem to have a fairly light-hearted bunch, so I would imagine 2010 will not throw them (or the robotic overlords who enslave them) too much of a curve. If I were to guess, I'd bet they go to 10.0. Brian From johnf@sac.sfbay.sun.com Wed Nov 5 10:12:46 2008 Received: from sunmail4.singapore.sun.com (sunmail4.Singapore.Sun.COM [129.158.71.19]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mA5ICjx1020022 for ; Wed, 5 Nov 2008 10:12:46 -0800 (PST) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail4.singapore.sun.com (8.13.4+Sun/8.13.3/ENSMAIL,v2.2) with ESMTP id mA5ICgLw013455 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Thu, 6 Nov 2008 02:12:44 +0800 (SGT) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K9V00M6JH97G800@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Wed, 05 Nov 2008 10:12:43 -0800 (PST) Received: from dm-sfbay-01.sfbay.sun.com ([129.145.155.118]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K9V00KMOH953F70@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Wed, 05 Nov 2008 10:12:41 -0800 (PST) Received: from sac.sfbay.sun.com (new-sac.SFBay.Sun.COM [129.146.175.65]) by dm-sfbay-01.sfbay.sun.com (8.13.8+Sun/8.13.8/ENSMAIL,v2.2) with ESMTP id mA5ICeqb011882; Wed, 05 Nov 2008 10:12:40 -0800 (PST) Received: from sac.sfbay.sun.com (localhost [127.0.0.1]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mA5ICeht020020; Wed, 05 Nov 2008 10:12:40 -0800 (PST) Received: (from johnf@localhost) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8/Submit) id mA5ICeP5020019; Wed, 05 Nov 2008 10:12:40 -0800 (PST) Date: Wed, 05 Nov 2008 10:12:40 -0800 (PST) From: John Fischer Subject: Re: Twisted update to 8.1 and adding Twisted-Web2 [PSARC/2008/670 FastTrack timeout 11/07/2008] To: Alan.Coopersmith@sun.com, Brian.Cameron@sun.com Cc: John.Fischer@sun.com, PSARC-ext@sun.com, johnf@sac.sfbay.sun.com Message-id: <200811051812.mA5ICeP5020019@sac.sfbay.sun.com> Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 Status: RO Content-Length: 129 Brian, This case was approved during PSARC today. I updated the proposal file to reflect that it went to PSARC. Thanks, John From Brian.Cameron@sun.com Wed Nov 5 14:38:18 2008 Received: from sunmail2sca.sfbay.sun.com (sunmail2sca.SFBay.Sun.COM [129.145.155.234]) by sac.sfbay.sun.com (8.13.8+Sun/8.13.8) with ESMTP id mA5McI4r028391 for ; Wed, 5 Nov 2008 14:38:18 -0800 (PST) Received: from nwk-avmta-2.sfbay.sun.com (nwk-avmta-2.SFBay.Sun.COM [129.145.155.6]) by sunmail2sca.sfbay.sun.com (8.13.7+Sun/8.13.7/ENSMAIL,v2.2) with ESMTP id mA5McHqA021479 for <@sunmail2sca.sfbay.sun.com:PSARC-ext@sun.com>; Wed, 5 Nov 2008 14:38:18 -0800 (PST) Received: from pmxchannel-daemon.nwk-avmta-2.sfbay.sun.com by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) id <0K9V00917TJSZF00@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Wed, 05 Nov 2008 14:38:16 -0800 (PST) Received: from brmea-mail-3.sun.com ([192.18.98.34]) by nwk-avmta-2.sfbay.sun.com (Sun Java System Messaging Server 6.2-3.04 (built Jul 15 2005)) with ESMTP id <0K9V003TYTJRE7D0@nwk-avmta-2.sfbay.sun.com> for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Wed, 05 Nov 2008 14:38:15 -0800 (PST) Received: from fe-amer-09.sun.com ([192.18.109.79]) by brmea-mail-3.sun.com (8.13.6+Sun/8.12.9) with ESMTP id mA5McFIG015472 for ; Wed, 05 Nov 2008 22:38:15 +0000 (GMT) Received: from conversion-daemon.mail-amer.sun.com by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) id <0K9V00101S4HWJ00@mail-amer.sun.com> (original mail from Brian.Cameron@Sun.COM) for PSARC-ext@sun.com (ORCPT PSARC-ext@sun.com); Wed, 05 Nov 2008 15:38:15 -0700 (MST) Received: from [129.153.250.186] by mail-amer.sun.com (Sun Java System Messaging Server 6.2-8.04 (built Feb 28 2007)) with ESMTPSA id <0K9V00CXTTJAQXF0@mail-amer.sun.com>; Wed, 05 Nov 2008 15:37:59 -0700 (MST) Date: Wed, 05 Nov 2008 15:37:30 -0600 From: Brian Cameron Subject: Re: Twisted update to 8.1 and adding Twisted-Web2 [PSARC/2008/670 FastTrack timeout 11/07/2008] In-reply-to: <200811051812.mA5ICeP5020019@sac.sfbay.sun.com> Sender: Brian.Cameron@sun.com To: John Fischer Cc: Alan.Coopersmith@sun.com, John.Fischer@sun.com, PSARC-ext@sun.com Message-id: <4912121A.6070307@sun.com> MIME-version: 1.0 Content-type: text/plain; format=flowed; charset=ISO-8859-1 Content-transfer-encoding: 7BIT X-PMX-Version: 5.4.1.325704 References: <200811051812.mA5ICeP5020019@sac.sfbay.sun.com> User-Agent: Thunderbird 2.0.0.16 (X11/20080922) Status: RO Content-Length: 154 John: > This case was approved during PSARC today. I updated the proposal file > to reflect that it went to PSARC. Thanks, that is great news. Brian